-- Logs begin at Fri 2022-08-26 08:10:05 UTC, end at Fri 2022-08-26 09:14:46 UTC. -- Aug 26 08:42:20.501051 dv-cinder-852364-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 08:42:20.509468 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 08:42:20 2022] *** Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: nodename: dv-cinder-852364-5-iscsi Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: machine: x86_64 Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: clock source: unix Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: pcre jit disabled Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: detected number of CPU cores: 4 Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: current working directory: / Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: detected binary path: /usr/bin/uwsgi-core Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: your processes number limit is 47680 Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: your memory page size is 4096 bytes Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: detected max file descriptor number: 2048 Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: lock engine: pthread robust mutexes Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: thunder lock: enabled Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 08:42:20.515449 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 08:42:20.555050 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: Python main interpreter initialized at 0x563ee6f769c0 Aug 26 08:42:20.555050 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: python threads support enabled Aug 26 08:42:20.555050 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: your server socket listen backlog is limited to 100 connections Aug 26 08:42:20.555050 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: your mercy for graceful operations on workers is 90 seconds Aug 26 08:42:20.555643 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 08:42:20.555643 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: *** Operational MODE: preforking *** Aug 26 08:42:20.555852 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: *** uWSGI is running in multiple interpreter mode *** Aug 26 08:42:20.555852 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: spawned uWSGI master process (pid: 117188) Aug 26 08:42:20.555979 dv-cinder-852364-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 08:42:20.557299 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: spawned uWSGI worker 1 (pid: 117189, cores: 1) Aug 26 08:42:20.557299 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: spawned uWSGI worker 2 (pid: 117190, cores: 1) Aug 26 08:42:20.557299 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 08:42:21.216008 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 08:42:21.247166 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 08:42:22.285967 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 08:42:22.285967 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: from cryptography.utils import int_from_bytes Aug 26 08:42:22.286636 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 08:42:22.286636 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: from cryptography.utils import int_from_bytes Aug 26 08:42:22.301712 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 08:42:22.301712 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: from cryptography.utils import int_from_bytes Aug 26 08:42:22.302307 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 08:42:22.302307 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: from cryptography.utils import int_from_bytes Aug 26 08:42:24.834322 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 08:42:24.835051 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 08:42:24.835130 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 08:42:24.835452 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 08:42:24.835725 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 08:42:24.836101 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.836431 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.836774 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.837080 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.837411 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.837725 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.838057 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.838375 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.838711 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.839007 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.839329 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.839426 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 08:42:24.839808 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-5-iscsi {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.839898 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 08:42:24.839987 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.840188 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 08:42:24.840333 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.840545 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 08:42:24.840646 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.840797 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 08:42:24.840887 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.841168 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.841277 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.841491 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.841602 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.841800 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.841932 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.842218 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.842316 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.842545 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.842757 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.842851 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.843125 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.843225 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.843445 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.843545 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.843806 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.843917 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.844120 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.844227 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.844437 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.844533 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.844760 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.844844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-5-iscsi {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.845074 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.845183 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.845374 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.845460 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.845682 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.845773 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.845994 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.846098 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-5-iscsi {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.846295 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.846390 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.846668 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.846805 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.847018 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.847128 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.847506 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.847603 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.847818 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.847917 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.848128 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.848222 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.848433 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.848528 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.848764 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.848893 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.849077 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.849183 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.849379 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.849476 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.849691 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.849778 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.849994 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.850101 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.850313 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.850401 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.850615 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.850701 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.850946 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.851038 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-5-iscsi {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.851262 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.851364 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.851586 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.851682 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.851900 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.851991 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.852207 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.852314 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.852460 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.852624 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.852771 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.852929 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.853093 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.853244 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.853415 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.853573 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.853741 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.853875 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.854009 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.854197 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.854294 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.854514 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.854602 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.854828 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.854945 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.855172 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.855261 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.855470 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.855557 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.855773 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.855874 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.856081 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.856174 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.856393 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.856479 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.856704 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.856803 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.857013 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.857101 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.857269 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.857416 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.857627 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.857722 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.857946 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.858046 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.858272 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.858359 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.858583 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.858680 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.858872 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.859041 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.859167 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.859322 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.859452 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.859577 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.859732 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.859887 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.860040 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.860231 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.860327 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.860554 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.860644 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.860865 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.860951 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.861191 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.861345 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.861508 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.861596 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.861812 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.861898 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.862153 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.862266 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.862467 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.862553 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.862778 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.862955 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.863123 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.863212 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.863428 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.863524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.863680 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.863773 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.863985 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.864114 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.864293 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.864387 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.864613 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.864700 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.864923 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.865019 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.865232 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.865320 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.865541 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.865627 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.865845 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.865933 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.866153 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.866239 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.866551 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.866762 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.866849 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.867094 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.867183 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.867401 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.867496 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.867711 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.867807 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.868017 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.868112 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.868283 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.868413 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.868550 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.868645 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.868851 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.868939 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.869165 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.869261 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.869471 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.869561 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.869773 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.869859 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.870077 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.870173 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.870373 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.870474 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.870677 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.870774 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.871005 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.871110 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.871310 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.871397 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.871614 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.871701 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.871917 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.872013 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.872223 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.872310 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.872624 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.872783 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.872883 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.873008 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.873145 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.873233 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.873466 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.873553 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.873770 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.873859 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.874080 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.874211 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.874395 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.874537 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.874699 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.874788 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.875026 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.875116 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.875339 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.875425 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.875641 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.875730 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.875944 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.876038 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.876250 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.876337 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.876549 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.876636 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.876850 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.876944 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.877149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.877235 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.877451 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.877546 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.877811 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.877906 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.878129 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.878225 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.878433 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.878601 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.878735 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.878935 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.879071 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.879214 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.879339 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.879456 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.879647 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.879783 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.879940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.880086 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.880232 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.880335 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.880582 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.880689 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.880989 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.881068 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.881310 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.881453 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.881621 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.881918 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.882058 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.882268 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.882463 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.882570 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.883213 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.883363 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.883533 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.883856 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.883988 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.884172 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.884439 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.884550 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.884817 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.885002 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.885138 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.885436 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.885534 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.885750 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.886067 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.886165 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:42:24.886398 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.886691 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.886778 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.887052 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.887241 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.887394 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.887744 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.887877 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.888060 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.888224 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.888448 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.888587 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.888840 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.889016 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.889158 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.889347 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.889474 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.889869 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.889967 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.890203 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.890329 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.890538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.890681 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.890858 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.891010 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.891204 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.891340 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.891526 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.891662 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.891847 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.891993 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.892195 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.892303 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.892526 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.892641 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.892845 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.892935 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.893161 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.893262 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.893514 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.893636 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.893831 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.893987 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.894150 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.894358 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.894480 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.894639 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.894808 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.895058 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.895170 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.895350 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.895532 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.895674 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.895882 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.896051 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.896192 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.896369 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.896513 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.896686 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.896835 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.896996 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.897146 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.897304 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.897452 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.897613 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.897763 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.897925 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.898084 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.898235 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.898416 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.898559 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.898729 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.898908 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.899078 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.899220 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.899388 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.899556 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.899766 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.899865 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.900002 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.900168 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.900311 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.900480 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.900618 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.900789 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.900928 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.901087 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.901233 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.901403 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.901568 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.901820 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.901908 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.902146 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.902236 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.902476 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.902565 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.902788 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.902877 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.903130 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.903220 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.903443 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.903534 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.903750 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.903852 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.904058 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.904152 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.904360 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.904461 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.904661 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.904833 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.904960 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.905154 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.905274 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.905471 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.905559 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.905787 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.905880 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.906115 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.906202 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.906432 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.906521 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.906748 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.906837 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.907119 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.907208 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.907446 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.907533 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.907753 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.907839 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.908058 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.908189 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.908358 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.908447 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.908665 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.908754 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.909004 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.909107 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.909376 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.909605 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.909830 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.909945 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.910121 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.910264 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.910407 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.910572 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.910659 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.910878 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.911041 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.911211 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.911306 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.911516 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.911610 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.911823 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.911923 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.912139 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.912227 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.912449 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.912536 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.912761 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.912857 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.913069 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.913156 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.913379 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.913467 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.913686 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.913781 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.913995 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.914091 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.914327 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.914413 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.914655 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.914751 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.914981 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.915085 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.915305 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.915434 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.915626 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.915714 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.915937 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.916032 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.916236 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.916324 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.916541 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.916629 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.916843 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.916929 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.917142 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.917233 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.917446 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.917580 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.917746 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.917872 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.918048 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.918184 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.918346 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.918440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.918646 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.918732 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.918968 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.919058 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.919271 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.919367 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.919592 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.919680 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.919898 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.919995 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.920200 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.920298 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.920502 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.920591 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.920802 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.920903 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.921141 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.921229 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.921442 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.921570 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.921778 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.921875 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.922105 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.922194 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.922419 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.922506 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.922734 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.922829 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.923066 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.923167 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.923379 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.923514 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.923701 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.924014 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.924099 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.924338 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.924616 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.924697 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.925002 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.925634 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.925709 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.925709 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.926432 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.926525 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.926525 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.926666 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.926732 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.926869 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.926971 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.927206 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.927358 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.927519 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.927725 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.927837 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.928132 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.928231 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.928448 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.928546 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.928762 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.928912 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.929060 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.929265 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.929427 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.929666 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.929831 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.929975 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.930117 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.930750 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.930941 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.931097 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.931097 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.931430 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.931528 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.931684 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.931755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.931822 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.931956 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.932049 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.932135 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.932360 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.932458 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.932675 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.932770 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.933012 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.933112 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.933335 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.933432 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.933681 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.933767 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.933986 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.934087 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.934293 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.934390 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.934600 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.934693 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.934957 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.935068 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.935253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.935349 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.935560 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.935647 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.935864 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.936027 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.936314 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.936401 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.936628 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.936722 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.936934 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.937038 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.937254 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.937343 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.937577 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.937664 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.937887 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.937976 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.938193 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.938287 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.938562 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.938663 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.938805 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.938915 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.939177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.939267 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.939497 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.939595 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.939809 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.939900 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.940123 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.940241 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.940487 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.940584 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.940796 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.940886 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.941098 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.941232 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.941409 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.941507 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.941714 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.941802 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.942014 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.942109 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.942319 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.942415 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.942625 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.942712 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.942971 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.943071 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.943279 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.943387 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.943720 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.943875 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.944072 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.944222 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.944379 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.944517 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.944684 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.944825 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.945006 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.945150 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.945316 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.945498 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.945620 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.945835 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.945923 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.946170 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.946264 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.946486 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.946574 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.946795 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.946909 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.947147 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.947233 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.947456 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.947544 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.947765 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.947860 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.948079 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.948166 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.948708 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.948815 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.948815 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.948950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.949079 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.949163 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.949296 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.949384 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.949607 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.949750 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.949914 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.950070 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.950212 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.950364 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.950505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.950652 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.950821 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.951012 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.951140 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.951391 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.951536 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.951755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.951894 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.952094 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.952242 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.952378 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.952523 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.952668 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.952808 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.952961 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.953095 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.953276 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.953421 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.953625 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.953782 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.953921 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.954239 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.954381 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.954564 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.954711 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.954906 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.955042 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.955222 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.955363 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.955532 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.955670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.955892 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.956034 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.956207 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.956458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.956594 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.956726 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.956869 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.957023 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.957157 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.957291 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.957448 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.957589 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.957729 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.957888 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.958021 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.958139 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.958296 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.958441 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.958656 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.958824 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.959186 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.959333 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.959479 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.959643 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.959782 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.959912 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.960050 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.960191 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.960322 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.960451 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.960451 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.960724 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.960854 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.960984 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.961119 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.961308 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.961431 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.961639 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.961782 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.961953 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.962209 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.962317 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.962610 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.962733 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.962952 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.963090 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.963266 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.963433 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.963576 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.963738 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.963883 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.964076 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.964208 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.964398 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.964536 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.964744 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.964882 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.965060 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.965200 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.965374 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.965502 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.965689 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.965861 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.966011 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.966170 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.966306 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.966431 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.966566 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.966711 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.966908 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.967086 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.967244 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.967376 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.967534 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.967709 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.967879 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.968142 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.968285 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.968599 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.968748 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.969170 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.969373 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.969532 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.969690 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.969826 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.969969 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.970152 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.970307 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.970463 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.970606 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.970758 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.971094 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.971242 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.971398 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.971679 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.971890 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.972057 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.972212 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.972417 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.972598 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.972737 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.972976 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.973114 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.973278 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.973577 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.973746 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.973919 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.974115 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.974266 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.974577 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.974675 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.974922 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.975200 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.975355 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.975556 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.975713 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.975861 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.976004 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.976172 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.976291 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.976501 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.976740 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.976905 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.977158 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.977338 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.977495 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.977789 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.977960 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.978120 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.978250 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.978392 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.978511 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.978728 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.978923 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.979113 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.979232 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.979405 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.979535 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.979734 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.979870 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.980052 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.980191 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.980360 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.980500 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.980666 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.980814 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.980979 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.981100 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.981341 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.981478 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.981665 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.981862 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.982005 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.982273 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.982425 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.982583 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.982718 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.982996 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.983143 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.983297 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.983424 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.983559 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.983703 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.983859 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.984008 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.984161 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.984306 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.984450 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.984592 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.984720 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.984851 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.985037 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.985174 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.985352 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.985647 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.985802 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.985959 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.986157 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.986308 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.986467 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.986623 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.986855 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.987071 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.987221 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.987368 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.987661 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.987823 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.987967 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.988108 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.988199 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.988420 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.988520 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.988770 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.988910 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.989075 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.989162 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.989394 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.989480 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.989723 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.989810 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.990034 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.990120 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.990350 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.990457 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.990662 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.990774 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.990997 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.991100 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.991311 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.991399 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.991616 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.991702 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.991932 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.992244 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.992340 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.992417 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.992597 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.992721 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.992902 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.992988 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.993202 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.993289 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.993506 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.993590 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.993818 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.993904 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.994128 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.994215 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.994447 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.994528 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.994769 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.994864 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.995118 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.995205 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.995421 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.995507 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.995835 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.995935 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.996149 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.996246 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.996457 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.996544 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.996765 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.996860 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.997073 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.997158 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.997405 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.997489 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.997717 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.997898 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.998036 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.998329 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.998474 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.998663 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.998808 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.999034 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.999178 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.999314 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.999580 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.999670 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:24.999902 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.000045 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.000240 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.000389 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.000565 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.000679 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.000886 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.001039 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.001205 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.001336 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.001510 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.001641 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.001823 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.001972 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.002134 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.002268 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.002447 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.002612 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.002747 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.003125 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.003268 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.003437 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.003571 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.003747 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.003883 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.004061 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.004203 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.004371 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.004514 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.004668 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.004840 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.004992 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.005125 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.005293 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.005436 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.005612 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.005756 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.005940 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.006074 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.006212 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.006357 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.006520 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.006664 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.006854 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.007097 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.007231 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.007368 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.007490 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.007638 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.008118 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.008270 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.008445 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.008584 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.008728 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.008882 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.009021 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.009141 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.009325 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.009480 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.009640 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.009780 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.009943 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.010137 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.010280 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.010420 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.010548 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.010692 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.011059 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.011217 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.011349 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.011474 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.011611 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.011748 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.011872 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.012004 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.012184 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.012305 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.012531 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.012689 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.012818 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.012950 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.013120 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.013218 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.013445 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.013537 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.013759 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.013898 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.014068 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.014205 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.014389 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.014539 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.014682 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.014825 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.014998 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.015244 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.015339 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.015563 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.015651 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.015874 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.015984 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.016192 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.016316 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.016503 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.016662 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.016811 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.016955 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.017173 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.017309 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.017407 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.017699 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.017798 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.018005 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.018108 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.018327 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.018438 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.018703 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.018796 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.019043 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.019246 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.019384 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.019546 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.019694 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.019836 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.019971 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.020084 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.020585 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.020732 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.020862 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.021002 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.021149 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.021288 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.021420 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.021546 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.021677 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.021817 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.021969 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.022095 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.022239 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.022370 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.022555 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.022708 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.022857 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.023062 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.023217 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.023411 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.023552 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.023695 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.023830 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.023961 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.024099 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.024224 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.024365 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.024512 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.024646 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.024766 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.024885 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.025037 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.025171 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.025344 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.025482 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.025650 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.025789 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.025933 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.026080 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.026220 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.026369 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.026567 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.026718 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.026863 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.027065 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.027201 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.027336 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.027513 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.027660 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.027836 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.028041 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.028179 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.028337 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.028483 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.028631 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.028786 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.028917 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.029047 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.029175 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.029371 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.029506 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.029690 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.029831 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.029991 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.030127 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.030294 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.030414 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.030597 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.030709 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.030947 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.031105 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.031258 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.031414 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.031587 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.031731 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.031869 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.032014 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.032125 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.032339 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.032428 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.032658 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.032791 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.032979 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.033103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.033260 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.033407 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.033586 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.033745 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.033888 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.033989 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.034208 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.034305 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.034510 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.034598 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.034811 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.035009 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.035150 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.035279 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.035479 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.035657 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.035835 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.035981 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.036142 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.036280 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.036461 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.036601 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.036786 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.036901 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.037099 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.037221 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.037531 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.037659 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.037843 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.037981 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.038155 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.038323 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.038463 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.038658 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.038762 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.039009 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.039102 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.039331 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.039418 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.039653 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.039745 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.039987 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.040114 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.040319 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.040544 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.040642 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.040870 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.040958 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.041183 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.041285 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.041488 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.041586 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.041796 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.041893 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.042116 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.042274 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.042420 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.042590 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.042726 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.042867 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.043085 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.043296 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.043439 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.043608 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.043702 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.043964 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.044076 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.044279 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.044417 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.044607 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.044763 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.044936 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.045086 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.045234 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.045360 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.045543 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.045632 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.045851 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.045938 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.046160 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.046261 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.046475 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.046627 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.046788 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.046981 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.047152 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.047301 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.047448 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.047592 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.047738 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.047876 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.048075 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.048174 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.048300 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.048389 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.048603 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.048690 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.048910 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.048998 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.049216 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.049303 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.049524 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.049631 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.049881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.049973 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.050190 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.050321 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.050496 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.050591 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.050811 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.050935 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.051147 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.051249 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.051451 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.051591 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.051762 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.051962 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.052074 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.052283 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.052381 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.052596 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.052683 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.052979 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.053146 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.053286 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.053457 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.053605 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.053800 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.053936 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.054097 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.054208 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.054417 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.054561 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.054727 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.054957 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.055194 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.055281 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.056449 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.056585 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.056662 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.056662 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.056783 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.056861 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.056931 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.056997 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.057297 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.057446 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.057593 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.057875 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.058036 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.058144 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.058223 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.058304 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.058533 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.058633 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.058846 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.058959 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.059200 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.059314 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.059577 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.059685 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.059890 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.060200 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.060516 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.060659 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.060845 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.061160 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.061380 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.061521 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.061664 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.061812 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.061963 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.062134 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.062305 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.062447 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.062631 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.062774 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.062955 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.063095 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.063288 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.063429 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.063600 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.063744 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.063962 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.064109 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.064252 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.064393 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.064546 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.064700 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.064852 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.064993 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.065116 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.065316 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.065465 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.065624 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.065764 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.065985 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.066104 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.066299 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.066387 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.066602 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.066695 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.066947 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.067051 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.067254 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.067364 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.067558 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.067654 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.067862 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.067959 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.068171 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.068270 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.068476 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.068572 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.068777 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.068865 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.069080 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.069177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.069380 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.069470 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.070141 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.070259 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.070343 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.070435 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.070524 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.070593 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.070667 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.070734 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.070865 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.071667 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.071762 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.071832 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.071918 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.072001 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.072097 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.072180 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.072262 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.072345 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.072425 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.072704 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.072883 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.073018 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.073221 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.073309 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.073627 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.073760 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.073934 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.074121 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.074241 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.074460 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.074586 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.074794 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.074913 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.075132 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.075446 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.075532 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.075755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.075867 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.076071 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.076165 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.076396 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.076473 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.076776 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.076952 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.077027 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.077107 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.077325 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.077422 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.077631 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.077723 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.077945 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.078047 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.078256 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.078343 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.078563 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.078653 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.078868 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.078976 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.079197 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.079306 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.079513 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.079603 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.079820 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.079911 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.080121 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.080219 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.080426 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.080514 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.080729 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.080816 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.081092 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.081194 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.081399 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.081496 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.081702 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.081780 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.082013 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.082123 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.082313 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.082403 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.082617 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.082704 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.082978 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.083097 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.083372 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.083537 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.083779 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.083915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.084002 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.084092 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.084275 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.084398 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.084485 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.084554 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.084769 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.084848 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.085073 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.085174 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.085378 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.085456 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.085690 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.085783 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.086016 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.086111 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.086324 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.086452 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.086633 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.086784 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.087009 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.087103 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.087327 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.087434 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.087642 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.087781 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.087955 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.088046 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.088262 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.088364 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.088573 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.088661 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.088889 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.088976 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.089196 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.089300 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.089510 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.089600 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.089816 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.089903 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.090142 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.090231 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.090462 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.090549 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.090781 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.090997 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.091102 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.091233 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.091438 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.091536 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.091764 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.091904 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.092072 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.092198 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.092490 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.092623 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.092703 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.092790 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.093007 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.093162 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.093321 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.093468 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.093634 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.093786 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.093950 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.094067 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.094250 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.094419 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.094614 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.094793 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.094988 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.095135 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.095272 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.095398 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.095539 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.095663 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.095776 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.095901 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.096152 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.096288 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.096453 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.096610 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.096784 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.096914 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.097085 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.097245 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.097400 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.097577 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.097710 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.097893 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.098025 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.098210 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.098355 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.098527 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.098654 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.098790 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 08:42:25.099017 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.099171 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.099455 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.099784 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.100133 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.100452 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.100758 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.101076 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.101379 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.101695 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.102016 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.102404 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.102719 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.103087 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.103393 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.103703 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.104011 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.104316 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.104620 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.104924 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.105248 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.105569 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.105872 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.106202 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.106517 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.106830 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.107163 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.107539 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.107894 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.108205 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.108521 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.108822 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.109127 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.109432 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.109742 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.110046 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.110354 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.110668 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.111004 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.111330 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.111653 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.111969 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.112326 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.112681 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.113027 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.113337 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.113681 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.114004 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.114313 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.114621 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.114940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:42:25.115187 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 08:42:25.253923 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO dbcounter [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Registered counter for database nova_api Aug 26 08:42:25.272138 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO dbcounter [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] Registered counter for database nova_api Aug 26 08:42:25.276797 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_db.sqlalchemy.engines [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:42:25.284771 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG dbcounter [-] [117189] Writer thread running {{(pid=117189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:42:25.292710 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG oslo_db.sqlalchemy.engines [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:42:25.300233 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG dbcounter [-] [117190] Writer thread running {{(pid=117190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:42:25.341924 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.context [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ca95b6a2-7122-49b3-ad9d-53c968d985a7(cell1) {{(pid=117189) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 08:42:25.345790 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:42:25.346268 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:42:25.347938 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:42:25.348711 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:42:25.349396 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:42:25.351386 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:42:25.353434 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO dbcounter [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Registered counter for database nova_cell0 Aug 26 08:42:25.357303 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.context [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ca95b6a2-7122-49b3-ad9d-53c968d985a7(cell1) {{(pid=117190) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 08:42:25.359486 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO dbcounter [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Registered counter for database nova_cell1 Aug 26 08:42:25.361333 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG oslo_concurrency.lockutils [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:42:25.361807 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG oslo_concurrency.lockutils [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:42:25.363718 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG oslo_concurrency.lockutils [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:42:25.364527 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG oslo_concurrency.lockutils [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:42:25.364979 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG oslo_concurrency.lockutils [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:42:25.367121 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG oslo_concurrency.lockutils [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:42:25.368037 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_db.sqlalchemy.engines [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:42:25.369601 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO dbcounter [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] Registered counter for database nova_cell0 Aug 26 08:42:25.371954 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_db.sqlalchemy.engines [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:42:25.374607 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG dbcounter [-] [117189] Writer thread running {{(pid=117189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:42:25.375605 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO dbcounter [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] Registered counter for database nova_cell1 Aug 26 08:42:25.385825 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG oslo_db.sqlalchemy.engines [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:42:25.387145 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG oslo_db.sqlalchemy.engines [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:42:25.400863 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG dbcounter [-] [117190] Writer thread running {{(pid=117190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:42:25.401200 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG dbcounter [-] [117190] Writer thread running {{(pid=117190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:42:25.519844 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG dbcounter [-] [117189] Writer thread running {{(pid=117189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:42:25.531202 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO dbcounter [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Registered counter for database nova_cell0 Aug 26 08:42:25.542322 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_db.sqlalchemy.engines [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:42:25.549718 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG dbcounter [-] [117189] Writer thread running {{(pid=117189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:42:25.550525 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO dbcounter [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] Registered counter for database nova_cell0 Aug 26 08:42:25.561807 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG oslo_db.sqlalchemy.engines [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:42:25.572076 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG dbcounter [-] [117190] Writer thread running {{(pid=117190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:42:25.904738 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: WARNING keystonemiddleware.auth_token [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 08:42:25.912320 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: WARNING keystonemiddleware.auth_token [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 08:42:25.916773 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: WARNING keystonemiddleware.auth_token [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 08:42:25.925772 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: WARNING keystonemiddleware.auth_token [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 08:42:26.269896 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: WARNING keystonemiddleware.auth_token [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 08:42:26.275863 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: WARNING keystonemiddleware.auth_token [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 08:42:26.281722 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563ee6f769c0 pid: 117189 (default app) Aug 26 08:42:26.283851 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:42:26.285125 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] 10.222.0.71 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001854 Aug 26 08:42:26.285510 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 788 bytes} [Fri Aug 26 08:42:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:42:26.286771 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: WARNING keystonemiddleware.auth_token [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 08:42:26.292833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: WARNING keystonemiddleware.auth_token [None req-654e56ef-4459-4136-a747-4df5d9d80a11 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 08:42:26.298088 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563ee6f769c0 pid: 117190 (default app) Aug 26 08:43:59.531453 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:43:59.533394 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002712 Aug 26 08:43:59.533802 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 2/2] 10.222.0.71 () {54 vars in 931 bytes} [Fri Aug 26 08:43:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:43:59.546238 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG dbcounter [-] [117190] Writing DB stats nova_api:SELECT=3 {{(pid=117190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:43:59.548429 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG dbcounter [-] [117190] Writing DB stats nova_cell1:SELECT=3 {{(pid=117190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:43:59.549406 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG dbcounter [-] [117190] Writing DB stats nova_cell0:SELECT=3 {{(pid=117190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:43:59.550149 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG dbcounter [-] [117190] Writing DB stats nova_cell0:SELECT=3 {{(pid=117190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:00.485529 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-86980fa1-f35a-4cb4-a931-0c07fa67a2e0 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:00.518068 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-86980fa1-f35a-4cb4-a931-0c07fa67a2e0 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.976908 Aug 26 08:44:00.518653 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 1/3] 10.222.0.71 () {60 vars in 1292 bytes} [Fri Aug 26 08:43:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:44:02.916954 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:02.917923 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-1b4c29a2-d08b-4455-afce-cc2de95a9204 None None] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 26 08:44:02.918506 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 3/4] 10.222.0.71 () {54 vars in 931 bytes} [Fri Aug 26 08:44:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:44:03.367700 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-12b38ece-180b-4c12-adb0-b575ff427b9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "id": "c1", "swap": 0}} {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:03.418060 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-12b38ece-180b-4c12-adb0-b575ff427b9e admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.493001 Aug 26 08:44:03.421090 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 2/5] 10.222.0.71 () {64 vars in 1283 bytes} [Fri Aug 26 08:44:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:44:03.635557 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-f3f8434a-5452-4706-9e7b-a84c19e8d578 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:03.642382 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG dbcounter [-] [117189] Writing DB stats nova_api:SELECT=3 {{(pid=117189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:03.643886 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG dbcounter [-] [117189] Writing DB stats nova_cell1:SELECT=3 {{(pid=117189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:03.644159 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG dbcounter [-] [117189] Writing DB stats nova_cell0:SELECT=3 {{(pid=117189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:03.645056 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG dbcounter [-] [117189] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:03.709909 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-f3f8434a-5452-4706-9e7b-a84c19e8d578 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282232 Aug 26 08:44:03.710987 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 4/6] 10.222.0.71 () {64 vars in 1336 bytes} [Fri Aug 26 08:44:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:44:06.115548 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-12b38ece-180b-4c12-adb0-b575ff427b9e admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:06.117876 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-12b38ece-180b-4c12-adb0-b575ff427b9e admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003390 Aug 26 08:44:06.118810 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 3/7] 10.222.0.71 () {54 vars in 931 bytes} [Fri Aug 26 08:44:06 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:44:06.881643 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-27b9b460-c3c8-4ecf-9f64-a3b04afd8a10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:06.923864 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-27b9b460-c3c8-4ecf-9f64-a3b04afd8a10 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.793742 Aug 26 08:44:06.924395 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 5/8] 10.222.0.71 () {64 vars in 1283 bytes} [Fri Aug 26 08:44:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:44:06.937095 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-b7d88b74-77e2-47f2-8fdb-58f9b3edb50a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:06.976763 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-b7d88b74-77e2-47f2-8fdb-58f9b3edb50a admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043703 Aug 26 08:44:06.977634 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 4/9] 10.222.0.71 () {64 vars in 1336 bytes} [Fri Aug 26 08:44:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:44:09.398467 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-27b9b460-c3c8-4ecf-9f64-a3b04afd8a10 admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:09.399717 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-27b9b460-c3c8-4ecf-9f64-a3b04afd8a10 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 Aug 26 08:44:09.400164 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 6/10] 10.222.0.71 () {54 vars in 931 bytes} [Fri Aug 26 08:44:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:44:09.835352 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-e3922289-09f9-42a0-b595-4d9b2e5bdf4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 1024, "vcpus": 1}} {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:09.855786 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-e3922289-09f9-42a0-b595-4d9b2e5bdf4d admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449083 Aug 26 08:44:09.856681 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 5/11] 10.222.0.71 () {64 vars in 1283 bytes} [Fri Aug 26 08:44:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:44:09.868938 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-de928e73-623c-41b5-8dd0-d10e14847533 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:09.895858 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-de928e73-623c-41b5-8dd0-d10e14847533 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030673 Aug 26 08:44:09.896474 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 7/12] 10.222.0.71 () {64 vars in 1336 bytes} [Fri Aug 26 08:44:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:44:12.304328 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-e3922289-09f9-42a0-b595-4d9b2e5bdf4d admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:12.305885 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-e3922289-09f9-42a0-b595-4d9b2e5bdf4d admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002093 Aug 26 08:44:12.307670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 6/13] 10.222.0.71 () {54 vars in 931 bytes} [Fri Aug 26 08:44:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:44:12.827806 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-1c8d7813-2cf4-4000-bdd9-c9944d5529d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "id": "d3", "disk": 10, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:12.848946 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-1c8d7813-2cf4-4000-bdd9-c9944d5529d7 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.535775 Aug 26 08:44:12.851035 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 8/14] 10.222.0.71 () {64 vars in 1283 bytes} [Fri Aug 26 08:44:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:44:12.864450 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-d7ea21d7-46f6-476b-8386-e156c7d31c2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:12.895924 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-d7ea21d7-46f6-476b-8386-e156c7d31c2e admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036929 Aug 26 08:44:12.903354 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 7/15] 10.222.0.71 () {64 vars in 1336 bytes} [Fri Aug 26 08:44:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:44:15.457002 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-1c8d7813-2cf4-4000-bdd9-c9944d5529d7 admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:15.458038 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-1c8d7813-2cf4-4000-bdd9-c9944d5529d7 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 26 08:44:15.458684 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 9/16] 10.222.0.71 () {54 vars in 931 bytes} [Fri Aug 26 08:44:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:44:16.019663 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-b9544dd5-af66-45cf-9a80-e780e439b9ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "name": "ds4G", "disk": 20, "os-flavor-access:is_public": true}} {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:16.043836 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-b9544dd5-af66-45cf-9a80-e780e439b9ed admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.577489 Aug 26 08:44:16.044873 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 8/17] 10.222.0.71 () {64 vars in 1283 bytes} [Fri Aug 26 08:44:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:44:16.056982 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-2677044b-a060-41d6-9cc3-5ba8b2383165 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:16.086070 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-2677044b-a060-41d6-9cc3-5ba8b2383165 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032601 Aug 26 08:44:16.086620 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 10/18] 10.222.0.71 () {64 vars in 1336 bytes} [Fri Aug 26 08:44:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:44:18.734542 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-b9544dd5-af66-45cf-9a80-e780e439b9ed admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:18.735876 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-b9544dd5-af66-45cf-9a80-e780e439b9ed admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002097 Aug 26 08:44:18.736403 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 9/19] 10.222.0.71 () {54 vars in 931 bytes} [Fri Aug 26 08:44:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:44:19.329002 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-76df779a-e835-4606-9f04-4b52c8e298e4 admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:19.359464 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-76df779a-e835-4606-9f04-4b52c8e298e4 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.614537 Aug 26 08:44:19.360788 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 11/20] 10.222.0.71 () {60 vars in 1292 bytes} [Fri Aug 26 08:44:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:44:22.221565 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-b9544dd5-af66-45cf-9a80-e780e439b9ed admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:22.222572 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-b9544dd5-af66-45cf-9a80-e780e439b9ed admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 26 08:44:22.223003 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 10/21] 10.222.0.71 () {54 vars in 931 bytes} [Fri Aug 26 08:44:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:44:22.685873 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-ef3e0636-47b1-4b17-89c6-28c7c0b57e25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1"}} {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:22.706518 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-ef3e0636-47b1-4b17-89c6-28c7c0b57e25 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.476811 Aug 26 08:44:22.707383 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 12/22] 10.222.0.71 () {64 vars in 1283 bytes} [Fri Aug 26 08:44:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:44:22.719782 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-b173d21f-d06f-4fbd-a314-c59c66493e3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:22.749883 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-b173d21f-d06f-4fbd-a314-c59c66493e3d admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033829 Aug 26 08:44:22.750916 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 11/23] 10.222.0.71 () {64 vars in 1333 bytes} [Fri Aug 26 08:44:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:44:25.204938 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-ef3e0636-47b1-4b17-89c6-28c7c0b57e25 admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:25.205953 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-ef3e0636-47b1-4b17-89c6-28c7c0b57e25 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 26 08:44:25.206355 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 13/24] 10.222.0.71 () {54 vars in 931 bytes} [Fri Aug 26 08:44:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:44:25.708863 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-3245758a-c61f-4f02-95d1-76d76d2b99c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:25.734269 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-3245758a-c61f-4f02-95d1-76d76d2b99c5 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.521420 Aug 26 08:44:25.734949 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 12/25] 10.222.0.71 () {64 vars in 1283 bytes} [Fri Aug 26 08:44:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:44:25.748141 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-0a0a3f3c-4695-41aa-8760-97a118682266 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:25.785592 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-0a0a3f3c-4695-41aa-8760-97a118682266 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041085 Aug 26 08:44:25.786826 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 14/26] 10.222.0.71 () {64 vars in 1333 bytes} [Fri Aug 26 08:44:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:44:28.413498 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-3245758a-c61f-4f02-95d1-76d76d2b99c5 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:28.413498 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-3245758a-c61f-4f02-95d1-76d76d2b99c5 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 26 08:44:28.414812 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 13/27] 10.222.0.71 () {54 vars in 931 bytes} [Fri Aug 26 08:44:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:44:28.923887 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-52da03e2-f65f-454f-9d96-be1bcaa7f7e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "id": "3", "ram": 4096, "rxtx_factor": 1.0}} {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:28.946790 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-52da03e2-f65f-454f-9d96-be1bcaa7f7e1 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.526124 Aug 26 08:44:28.947383 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 15/28] 10.222.0.71 () {64 vars in 1283 bytes} [Fri Aug 26 08:44:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:44:28.963891 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-6994d728-494f-4ff1-8603-bf8f631f7884 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:29.023974 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-6994d728-494f-4ff1-8603-bf8f631f7884 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066791 Aug 26 08:44:29.025304 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 14/29] 10.222.0.71 () {64 vars in 1333 bytes} [Fri Aug 26 08:44:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:44:31.610347 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-52da03e2-f65f-454f-9d96-be1bcaa7f7e1 admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:31.611581 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-52da03e2-f65f-454f-9d96-be1bcaa7f7e1 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002590 Aug 26 08:44:31.612097 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 16/30] 10.222.0.71 () {54 vars in 931 bytes} [Fri Aug 26 08:44:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:44:32.293701 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-003b2166-a24b-4003-94f6-54dda9281a5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "id": "4"}} {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:32.303511 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG dbcounter [-] [117190] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=117190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:32.337085 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-003b2166-a24b-4003-94f6-54dda9281a5d admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.711835 Aug 26 08:44:32.341485 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 15/31] 10.222.0.71 () {64 vars in 1283 bytes} [Fri Aug 26 08:44:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:44:32.346615 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-6a199578-1839-4939-8869-0fd557375b8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:32.403366 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-6a199578-1839-4939-8869-0fd557375b8d admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060662 Aug 26 08:44:32.403931 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 17/32] 10.222.0.71 () {64 vars in 1333 bytes} [Fri Aug 26 08:44:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:44:35.656984 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-003b2166-a24b-4003-94f6-54dda9281a5d admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:35.660488 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-003b2166-a24b-4003-94f6-54dda9281a5d admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004080 Aug 26 08:44:35.661891 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 16/33] 10.222.0.71 () {54 vars in 931 bytes} [Fri Aug 26 08:44:35 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:44:36.274564 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-f19da90b-1e86-43d8-b942-4e38f8afd8c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "disk": 160, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0}} {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:36.280420 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG dbcounter [-] [117189] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=117189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:36.309303 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-f19da90b-1e86-43d8-b942-4e38f8afd8c8 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.636505 Aug 26 08:44:36.310326 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 18/34] 10.222.0.71 () {64 vars in 1283 bytes} [Fri Aug 26 08:44:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:44:36.323932 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-20ac871e-8c1e-4e26-808c-721a1359153b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:44:36.369887 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-20ac871e-8c1e-4e26-808c-721a1359153b admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050375 Aug 26 08:44:36.371597 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 17/35] 10.222.0.71 () {64 vars in 1333 bytes} [Fri Aug 26 08:44:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:44:56.402334 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-f19da90b-1e86-43d8-b942-4e38f8afd8c8 admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:56.403439 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-f19da90b-1e86-43d8-b942-4e38f8afd8c8 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Aug 26 08:44:56.403854 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 19/36] 10.222.0.71 () {54 vars in 931 bytes} [Fri Aug 26 08:44:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:44:56.417359 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG dbcounter [-] [117190] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=117190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:44:56.960565 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-abe550ae-dc1e-4c76-ae19-b5ffdbe11910 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:56.980906 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-abe550ae-dc1e-4c76-ae19-b5ffdbe11910 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.569030 Aug 26 08:44:56.981394 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 18/37] 10.222.0.71 () {60 vars in 1292 bytes} [Fri Aug 26 08:44:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:44:58.154202 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-f19da90b-1e86-43d8-b942-4e38f8afd8c8 admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:58.155271 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-f19da90b-1e86-43d8-b942-4e38f8afd8c8 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Aug 26 08:44:58.155683 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 20/38] 10.222.0.71 () {56 vars in 1074 bytes} [Fri Aug 26 08:44:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:44:58.842723 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-b205a654-c5a0-47ca-92a5-99f0129798ff admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:58.853595 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.wsgi [None req-b205a654-c5a0-47ca-92a5-99f0129798ff admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-b205a654-c5a0-47ca-92a5-99f0129798ff admin admin] Request method failure captured: Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Accept: application/json Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Accept-Encoding: gzip, deflate Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Connection: keep-alive Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Content-Length: 0 Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Host: 10.222.0.71 Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Openstack-Api-Version: compute 2.90 Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Openstack-System-Scope: None Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: User-Agent: python-novaclient Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Auth-Token: gAAAAABjCIgKB5vjwxXAt9Hv-hBsxxT0px8Xg0V21qvTkljnYLfygevSrB2kQb87E5cuQfZbNyI8M-nTMtcrSEBxjxLtNv1eymy2n3WK-6e7b0n9D4bbPLm8-R_eRZf86mz2e7Ph0oMb4PZ-NcGRWcNzrEUrripfj9YMi-rkg5ScXWTcqnWxCm0 Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Domain-Id: None Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Domain-Name: None Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Identity-Status: Confirmed Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Is-Admin-Project: True Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Project-Domain-Id: default Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Project-Domain-Name: Default Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Project-Id: 45132fb08c454ebaa1180c0b933c68b7 Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Project-Name: admin Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Role: member,admin,reader Aug 26 08:44:58.858940 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Roles: member,admin,reader Aug 26 08:44:58.861844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_45132fb08c454ebaa1180c0b933c68b7", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:44:58.861844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Tenant: admin Aug 26 08:44:58.861844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Tenant-Id: 45132fb08c454ebaa1180c0b933c68b7 Aug 26 08:44:58.861844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Tenant-Name: admin Aug 26 08:44:58.861844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User: admin Aug 26 08:44:58.861844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User-Domain-Id: default Aug 26 08:44:58.861844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User-Domain-Name: Default Aug 26 08:44:58.861844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User-Id: 668b82af2c1345cca572ef92fff86ff2 Aug 26 08:44:58.861844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User-Name: admin Aug 26 08:44:58.861844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: method: > Aug 26 08:44:58.861844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: exception: Flavor 42 could not be found. Aug 26 08:44:58.861844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: action_args: {'id': '42'} Aug 26 08:44:58.861844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:44:58.861844 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:44:58.863670 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:44:58.866458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-b205a654-c5a0-47ca-92a5-99f0129798ff admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:44:58.869270 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-b205a654-c5a0-47ca-92a5-99f0129798ff admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.559353 Aug 26 08:44:58.869270 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 19/39] 10.222.0.71 () {60 vars in 1190 bytes} [Fri Aug 26 08:44:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 562 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 26 08:44:58.877676 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-b13972f2-1799-471a-a1d3-cfdc9d7bd591 admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:58.910852 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-b13972f2-1799-471a-a1d3-cfdc9d7bd591 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.038371 Aug 26 08:44:58.911815 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 21/40] 10.222.0.71 () {60 vars in 1210 bytes} [Fri Aug 26 08:44:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:44:58.928270 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-1758d615-4a0d-4c59-af85-0df0f94217c1 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:58.963150 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-1758d615-4a0d-4c59-af85-0df0f94217c1 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.040795 Aug 26 08:44:58.964011 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 20/41] 10.222.0.71 () {60 vars in 1210 bytes} [Fri Aug 26 08:44:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:44:58.976916 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-41c57784-0263-4723-a186-c8ce4225e2ca admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:44:58.998640 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.wsgi [None req-41c57784-0263-4723-a186-c8ce4225e2ca admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-41c57784-0263-4723-a186-c8ce4225e2ca admin admin] Request method failure captured: Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Accept: application/json Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Accept-Encoding: gzip, deflate Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Connection: keep-alive Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Content-Length: 0 Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Host: 10.222.0.71 Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Openstack-Api-Version: compute 2.90 Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Openstack-System-Scope: None Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: User-Agent: python-novaclient Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Auth-Token: gAAAAABjCIgKB5vjwxXAt9Hv-hBsxxT0px8Xg0V21qvTkljnYLfygevSrB2kQb87E5cuQfZbNyI8M-nTMtcrSEBxjxLtNv1eymy2n3WK-6e7b0n9D4bbPLm8-R_eRZf86mz2e7Ph0oMb4PZ-NcGRWcNzrEUrripfj9YMi-rkg5ScXWTcqnWxCm0 Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Domain-Id: None Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Domain-Name: None Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Identity-Status: Confirmed Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Is-Admin-Project: True Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Project-Domain-Id: default Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Project-Domain-Name: Default Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Project-Id: 45132fb08c454ebaa1180c0b933c68b7 Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Project-Name: admin Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Role: member,admin,reader Aug 26 08:44:59.003950 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Roles: member,admin,reader Aug 26 08:44:59.006524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_45132fb08c454ebaa1180c0b933c68b7", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:44:59.006524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Tenant: admin Aug 26 08:44:59.006524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Tenant-Id: 45132fb08c454ebaa1180c0b933c68b7 Aug 26 08:44:59.006524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Tenant-Name: admin Aug 26 08:44:59.006524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User: admin Aug 26 08:44:59.006524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User-Domain-Id: default Aug 26 08:44:59.006524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User-Domain-Name: Default Aug 26 08:44:59.006524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User-Id: 668b82af2c1345cca572ef92fff86ff2 Aug 26 08:44:59.006524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User-Name: admin Aug 26 08:44:59.006524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: method: > Aug 26 08:44:59.006524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: exception: Flavor 42 could not be found. Aug 26 08:44:59.006524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: action_args: {'id': '42'} Aug 26 08:44:59.006524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:44:59.006524 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:44:59.008193 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:44:59.010385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-41c57784-0263-4723-a186-c8ce4225e2ca admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:44:59.012490 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-41c57784-0263-4723-a186-c8ce4225e2ca admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.032918 Aug 26 08:44:59.012490 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 22/42] 10.222.0.71 () {60 vars in 1190 bytes} [Fri Aug 26 08:44:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 26 08:45:00.100047 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-1758d615-4a0d-4c59-af85-0df0f94217c1 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:00.101065 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-1758d615-4a0d-4c59-af85-0df0f94217c1 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 26 08:45:00.101458 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 21/43] 10.222.0.71 () {56 vars in 1074 bytes} [Fri Aug 26 08:45:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:45:00.704062 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-bde2639a-060c-4117-a1dc-0adb981a969b admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:00.711645 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.wsgi [None req-bde2639a-060c-4117-a1dc-0adb981a969b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-bde2639a-060c-4117-a1dc-0adb981a969b admin admin] Request method failure captured: Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Accept: application/json Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Accept-Encoding: gzip, deflate Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Connection: keep-alive Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Content-Length: 0 Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Host: 10.222.0.71 Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Openstack-Api-Version: compute 2.90 Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Openstack-System-Scope: None Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: User-Agent: python-novaclient Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Auth-Token: gAAAAABjCIgLiKRsF2BK1AGjK6qBs_Kg1EdnzU1TVTR9Hpe1NO7K-NpLj4g6P2_ccIdit4lGxZ5Ri7yRQh1WWtxXfJG8-klfA2fQko-nQZRzrXZzwuQSXcr0D72HHoqe7XTCNSFV1Uo7VVcmMjFUndnqOEY2HRu6SMLjxHe5hjYTiD0PY2TGwLE Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Domain-Id: None Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Domain-Name: None Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Identity-Status: Confirmed Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Is-Admin-Project: True Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Project-Domain-Id: default Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Project-Domain-Name: Default Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Project-Id: 45132fb08c454ebaa1180c0b933c68b7 Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Project-Name: admin Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Role: member,admin,reader Aug 26 08:45:00.713149 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Roles: member,admin,reader Aug 26 08:45:00.715505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_45132fb08c454ebaa1180c0b933c68b7", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:45:00.715505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Tenant: admin Aug 26 08:45:00.715505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Tenant-Id: 45132fb08c454ebaa1180c0b933c68b7 Aug 26 08:45:00.715505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Tenant-Name: admin Aug 26 08:45:00.715505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User: admin Aug 26 08:45:00.715505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User-Domain-Id: default Aug 26 08:45:00.715505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User-Domain-Name: Default Aug 26 08:45:00.715505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User-Id: 668b82af2c1345cca572ef92fff86ff2 Aug 26 08:45:00.715505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User-Name: admin Aug 26 08:45:00.715505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: method: > Aug 26 08:45:00.715505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: exception: Flavor 84 could not be found. Aug 26 08:45:00.715505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: action_args: {'id': '84'} Aug 26 08:45:00.715505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:45:00.715505 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:45:00.716755 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:45:00.718440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-bde2639a-060c-4117-a1dc-0adb981a969b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:45:00.720453 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-bde2639a-060c-4117-a1dc-0adb981a969b admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.475010 Aug 26 08:45:00.720453 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 23/44] 10.222.0.71 () {60 vars in 1190 bytes} [Fri Aug 26 08:45:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 476 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:00.724349 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-aa04a707-47bc-475b-99b4-7efef31ec550 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:00.740148 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-aa04a707-47bc-475b-99b4-7efef31ec550 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019394 Aug 26 08:45:00.740728 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 22/45] 10.222.0.71 () {60 vars in 1210 bytes} [Fri Aug 26 08:45:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:45:00.750344 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-ee429c71-5e60-4013-9ea0-4705b2ecd7ec admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:00.766010 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-ee429c71-5e60-4013-9ea0-4705b2ecd7ec admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019215 Aug 26 08:45:00.766553 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 24/46] 10.222.0.71 () {60 vars in 1210 bytes} [Fri Aug 26 08:45:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:45:00.777481 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-8c9b1baa-a354-4320-8c2f-f4e2cae647b5 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:00.783308 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.wsgi [None req-8c9b1baa-a354-4320-8c2f-f4e2cae647b5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-8c9b1baa-a354-4320-8c2f-f4e2cae647b5 admin admin] Request method failure captured: Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Accept: application/json Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Accept-Encoding: gzip, deflate Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Connection: keep-alive Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Content-Length: 0 Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Host: 10.222.0.71 Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Openstack-Api-Version: compute 2.90 Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Openstack-System-Scope: None Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: User-Agent: python-novaclient Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Auth-Token: gAAAAABjCIgLiKRsF2BK1AGjK6qBs_Kg1EdnzU1TVTR9Hpe1NO7K-NpLj4g6P2_ccIdit4lGxZ5Ri7yRQh1WWtxXfJG8-klfA2fQko-nQZRzrXZzwuQSXcr0D72HHoqe7XTCNSFV1Uo7VVcmMjFUndnqOEY2HRu6SMLjxHe5hjYTiD0PY2TGwLE Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Domain-Id: None Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Domain-Name: None Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Identity-Status: Confirmed Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Is-Admin-Project: True Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Project-Domain-Id: default Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Project-Domain-Name: Default Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Project-Id: 45132fb08c454ebaa1180c0b933c68b7 Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Project-Name: admin Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Role: member,admin,reader Aug 26 08:45:00.784833 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Roles: member,admin,reader Aug 26 08:45:00.786456 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_45132fb08c454ebaa1180c0b933c68b7", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:45:00.786456 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Tenant: admin Aug 26 08:45:00.786456 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Tenant-Id: 45132fb08c454ebaa1180c0b933c68b7 Aug 26 08:45:00.786456 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Tenant-Name: admin Aug 26 08:45:00.786456 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User: admin Aug 26 08:45:00.786456 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User-Domain-Id: default Aug 26 08:45:00.786456 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User-Domain-Name: Default Aug 26 08:45:00.786456 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User-Id: 668b82af2c1345cca572ef92fff86ff2 Aug 26 08:45:00.786456 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User-Name: admin Aug 26 08:45:00.786456 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: method: > Aug 26 08:45:00.786456 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: exception: Flavor 84 could not be found. Aug 26 08:45:00.786456 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: action_args: {'id': '84'} Aug 26 08:45:00.786456 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:45:00.786456 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:45:00.787538 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:45:00.789760 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-8c9b1baa-a354-4320-8c2f-f4e2cae647b5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:45:00.792073 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-8c9b1baa-a354-4320-8c2f-f4e2cae647b5 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013251 Aug 26 08:45:00.792073 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 23/47] 10.222.0.71 () {60 vars in 1190 bytes} [Fri Aug 26 08:45:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:01.888209 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-ee429c71-5e60-4013-9ea0-4705b2ecd7ec admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:01.889118 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-ee429c71-5e60-4013-9ea0-4705b2ecd7ec admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001798 Aug 26 08:45:01.889511 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 25/48] 10.222.0.71 () {56 vars in 1074 bytes} [Fri Aug 26 08:45:01 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:45:02.519857 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-54d9c15e-21c1-4807-8886-0aaebc0316ea admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:02.526261 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.wsgi [None req-54d9c15e-21c1-4807-8886-0aaebc0316ea admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-54d9c15e-21c1-4807-8886-0aaebc0316ea admin admin] Request method failure captured: Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Accept: application/json Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Accept-Encoding: gzip, deflate Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Connection: keep-alive Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Content-Length: 0 Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Host: 10.222.0.71 Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Openstack-Api-Version: compute 2.90 Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Openstack-System-Scope: None Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: User-Agent: python-novaclient Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Auth-Token: gAAAAABjCIgNOz4zqxU7EMGV95zSDqhIkxyeLiGKbaiMAE0PelsEK3LBI-6SgJJQWhqkROBG1l_2pBEx63nQlA70pOiOUpmm0IQVHlW7TIBzX9pUmkCayNyGsloofTxiHgolybhpGz3Tm6Ygk8QwlEgYbxQjbzxRrGtSZIT535eDmZvcSDn0Byk Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Domain-Id: None Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Domain-Name: None Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Identity-Status: Confirmed Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Is-Admin-Project: True Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Project-Domain-Id: default Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Project-Domain-Name: Default Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Project-Id: 45132fb08c454ebaa1180c0b933c68b7 Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Project-Name: admin Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Role: member,admin,reader Aug 26 08:45:02.527881 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Roles: member,admin,reader Aug 26 08:45:02.529408 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_45132fb08c454ebaa1180c0b933c68b7", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:45:02.529408 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Tenant: admin Aug 26 08:45:02.529408 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Tenant-Id: 45132fb08c454ebaa1180c0b933c68b7 Aug 26 08:45:02.529408 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-Tenant-Name: admin Aug 26 08:45:02.529408 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User: admin Aug 26 08:45:02.529408 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User-Domain-Id: default Aug 26 08:45:02.529408 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User-Domain-Name: Default Aug 26 08:45:02.529408 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User-Id: 668b82af2c1345cca572ef92fff86ff2 Aug 26 08:45:02.529408 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: X-User-Name: admin Aug 26 08:45:02.529408 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: method: > Aug 26 08:45:02.529408 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: exception: Flavor 451 could not be found. Aug 26 08:45:02.529408 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: action_args: {'id': '451'} Aug 26 08:45:02.529408 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:45:02.529408 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:45:02.530448 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: ERROR nova.api.openstack.wsgi Aug 26 08:45:02.531787 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-54d9c15e-21c1-4807-8886-0aaebc0316ea admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:45:02.533158 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-54d9c15e-21c1-4807-8886-0aaebc0316ea admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.468500 Aug 26 08:45:02.533158 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 24/49] 10.222.0.71 () {60 vars in 1193 bytes} [Fri Aug 26 08:45:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 470 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:02.541385 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-6abaa860-26ba-409c-ab0f-b63e57443279 admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:02.566632 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-6abaa860-26ba-409c-ab0f-b63e57443279 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029956 Aug 26 08:45:02.567393 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 26/50] 10.222.0.71 () {60 vars in 1210 bytes} [Fri Aug 26 08:45:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:45:02.578560 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-44a03fe4-36f7-4ece-959c-a48d26fefec3 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:02.602110 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-44a03fe4-36f7-4ece-959c-a48d26fefec3 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027119 Aug 26 08:45:02.602707 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 25/51] 10.222.0.71 () {60 vars in 1210 bytes} [Fri Aug 26 08:45:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:45:02.613528 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-91d453c5-2950-4362-8120-01541dccb663 admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:02.619649 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.wsgi [None req-91d453c5-2950-4362-8120-01541dccb663 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-91d453c5-2950-4362-8120-01541dccb663 admin admin] Request method failure captured: Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Accept: application/json Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Accept-Encoding: gzip, deflate Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Connection: keep-alive Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Content-Length: 0 Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Host: 10.222.0.71 Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Openstack-Api-Version: compute 2.90 Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Openstack-System-Scope: None Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: User-Agent: python-novaclient Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Auth-Token: gAAAAABjCIgNOz4zqxU7EMGV95zSDqhIkxyeLiGKbaiMAE0PelsEK3LBI-6SgJJQWhqkROBG1l_2pBEx63nQlA70pOiOUpmm0IQVHlW7TIBzX9pUmkCayNyGsloofTxiHgolybhpGz3Tm6Ygk8QwlEgYbxQjbzxRrGtSZIT535eDmZvcSDn0Byk Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Domain-Id: None Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Domain-Name: None Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Identity-Status: Confirmed Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Is-Admin-Project: True Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Project-Domain-Id: default Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Project-Domain-Name: Default Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Project-Id: 45132fb08c454ebaa1180c0b933c68b7 Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Project-Name: admin Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Role: member,admin,reader Aug 26 08:45:02.621177 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Roles: member,admin,reader Aug 26 08:45:02.623253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_45132fb08c454ebaa1180c0b933c68b7", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/45132fb08c454ebaa1180c0b933c68b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:45:02.623253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Tenant: admin Aug 26 08:45:02.623253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Tenant-Id: 45132fb08c454ebaa1180c0b933c68b7 Aug 26 08:45:02.623253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-Tenant-Name: admin Aug 26 08:45:02.623253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User: admin Aug 26 08:45:02.623253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User-Domain-Id: default Aug 26 08:45:02.623253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User-Domain-Name: Default Aug 26 08:45:02.623253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User-Id: 668b82af2c1345cca572ef92fff86ff2 Aug 26 08:45:02.623253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: X-User-Name: admin Aug 26 08:45:02.623253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: method: > Aug 26 08:45:02.623253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: exception: Flavor 451 could not be found. Aug 26 08:45:02.623253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: action_args: {'id': '451'} Aug 26 08:45:02.623253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:45:02.623253 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:45:02.624915 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: ERROR nova.api.openstack.wsgi Aug 26 08:45:02.627103 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-91d453c5-2950-4362-8120-01541dccb663 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:45:02.628259 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-91d453c5-2950-4362-8120-01541dccb663 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013011 Aug 26 08:45:02.628259 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 27/52] 10.222.0.71 () {60 vars in 1193 bytes} [Fri Aug 26 08:45:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 08:45:03.628254 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-44a03fe4-36f7-4ece-959c-a48d26fefec3 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:03.629680 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-44a03fe4-36f7-4ece-959c-a48d26fefec3 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 26 08:45:03.629680 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 26/53] 10.222.0.71 () {56 vars in 1074 bytes} [Fri Aug 26 08:45:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:45:04.236747 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-bd37f128-5973-43c2-a001-a7641b9391c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:45:04.265499 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-bd37f128-5973-43c2-a001-a7641b9391c4 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.496760 Aug 26 08:45:04.266078 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 28/54] 10.222.0.71 () {64 vars in 1235 bytes} [Fri Aug 26 08:45:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:45:05.277880 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-44a03fe4-36f7-4ece-959c-a48d26fefec3 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:05.279428 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-44a03fe4-36f7-4ece-959c-a48d26fefec3 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001862 Aug 26 08:45:05.279591 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 27/55] 10.222.0.71 () {56 vars in 1074 bytes} [Fri Aug 26 08:45:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:45:05.866608 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-93eb9f75-286d-445a-9578-54d570e81cca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:45:05.888543 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-93eb9f75-286d-445a-9578-54d570e81cca admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.470225 Aug 26 08:45:05.889095 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 29/56] 10.222.0.71 () {64 vars in 1235 bytes} [Fri Aug 26 08:45:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:45:06.913498 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-44a03fe4-36f7-4ece-959c-a48d26fefec3 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:06.915367 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-44a03fe4-36f7-4ece-959c-a48d26fefec3 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002592 Aug 26 08:45:06.916013 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 28/57] 10.222.0.71 () {56 vars in 1074 bytes} [Fri Aug 26 08:45:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:45:07.576438 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-ade7f43a-075b-479f-8e94-740027149932 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:45:07.600464 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-ade7f43a-075b-479f-8e94-740027149932 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.517030 Aug 26 08:45:07.601805 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 30/58] 10.222.0.71 () {64 vars in 1235 bytes} [Fri Aug 26 08:45:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:45:08.660399 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-44a03fe4-36f7-4ece-959c-a48d26fefec3 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:08.661390 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-44a03fe4-36f7-4ece-959c-a48d26fefec3 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 26 08:45:08.661780 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 29/59] 10.222.0.71 () {56 vars in 1074 bytes} [Fri Aug 26 08:45:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:45:09.237983 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-d50177fe-b3ae-4bd2-9e8f-19c2cb7c8fe2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:45:09.259482 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-d50177fe-b3ae-4bd2-9e8f-19c2cb7c8fe2 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.455798 Aug 26 08:45:09.260044 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 31/60] 10.222.0.71 () {64 vars in 1235 bytes} [Fri Aug 26 08:45:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:45:10.282041 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-44a03fe4-36f7-4ece-959c-a48d26fefec3 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:10.283368 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-44a03fe4-36f7-4ece-959c-a48d26fefec3 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Aug 26 08:45:10.283883 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 30/61] 10.222.0.71 () {56 vars in 1074 bytes} [Fri Aug 26 08:45:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:45:10.959292 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-6b99f915-a206-4eff-ac9f-19a3e61ab008 admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:45:10.984113 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-6b99f915-a206-4eff-ac9f-19a3e61ab008 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.553062 Aug 26 08:45:10.984722 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 32/62] 10.222.0.71 () {60 vars in 1202 bytes} [Fri Aug 26 08:45:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:46:09.817366 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-44a03fe4-36f7-4ece-959c-a48d26fefec3 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:46:09.818280 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-44a03fe4-36f7-4ece-959c-a48d26fefec3 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 26 08:46:09.818694 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 31/63] 10.222.0.71 () {54 vars in 931 bytes} [Fri Aug 26 08:46:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:46:09.829999 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG dbcounter [-] [117189] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=117189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:10.415940 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-c949a3f4-ae3a-4697-bedd-d2ff68ce7efc admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:46:10.437372 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-c949a3f4-ae3a-4697-bedd-d2ff68ce7efc admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.612251 Aug 26 08:46:10.437928 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 33/64] 10.222.0.71 () {60 vars in 1292 bytes} [Fri Aug 26 08:46:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:46:10.460297 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG dbcounter [-] [117190] Writing DB stats nova_api:SELECT=14 {{(pid=117190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:46:10.464444 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-f810865f-0eab-4e22-af67-a5910af114d3 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:46:10.473734 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-f810865f-0eab-4e22-af67-a5910af114d3 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015704 Aug 26 08:46:10.474303 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 32/65] 10.222.0.71 () {60 vars in 1283 bytes} [Fri Aug 26 08:46:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:46:10.488588 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-0a9e8e94-4794-42f8-afe4-00e21c9cf8ce admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:46:10.501509 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-0a9e8e94-4794-42f8-afe4-00e21c9cf8ce admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016293 Aug 26 08:46:10.503150 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 34/66] 10.222.0.71 () {60 vars in 1286 bytes} [Fri Aug 26 08:46:10 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:46:10.515561 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-3d77616e-407d-45ec-b8e2-7b06cc09abe3 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:46:10.525608 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-3d77616e-407d-45ec-b8e2-7b06cc09abe3 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013800 Aug 26 08:46:10.526152 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 33/67] 10.222.0.71 () {60 vars in 1286 bytes} [Fri Aug 26 08:46:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:46:10.547174 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-96307f36-482b-428e-b823-a1303b02ee6b admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:46:10.555440 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-96307f36-482b-428e-b823-a1303b02ee6b admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012156 Aug 26 08:46:10.555989 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 35/68] 10.222.0.71 () {60 vars in 1283 bytes} [Fri Aug 26 08:46:10 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:49:23.965800 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-3d77616e-407d-45ec-b8e2-7b06cc09abe3 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:49:23.967673 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-3d77616e-407d-45ec-b8e2-7b06cc09abe3 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002576 Aug 26 08:49:23.968464 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 34/69] 10.222.0.71 () {56 vars in 1074 bytes} [Fri Aug 26 08:49:23 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:49:24.111550 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG dbcounter [-] [117189] Writing DB stats nova_api:SELECT=6 {{(pid=117189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:49:24.286612 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-fe45db2a-8ff5-49c3-af43-0669a711361a admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:49:24.290183 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-fe45db2a-8ff5-49c3-af43-0669a711361a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:49:24.290696 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-fe45db2a-8ff5-49c3-af43-0669a711361a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:49:24.291150 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-fe45db2a-8ff5-49c3-af43-0669a711361a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:49:24.291859 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-fe45db2a-8ff5-49c3-af43-0669a711361a admin admin] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:49:24.292297 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-fe45db2a-8ff5-49c3-af43-0669a711361a admin admin] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:49:24.292710 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-fe45db2a-8ff5-49c3-af43-0669a711361a admin admin] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:49:24.327840 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-fe45db2a-8ff5-49c3-af43-0669a711361a admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.217749 Aug 26 08:49:24.328404 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 36/70] 10.222.0.71 () {60 vars in 1193 bytes} [Fri Aug 26 08:49:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:49:25.177988 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-3d77616e-407d-45ec-b8e2-7b06cc09abe3 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:49:25.179290 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-3d77616e-407d-45ec-b8e2-7b06cc09abe3 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002237 Aug 26 08:49:25.179740 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 35/71] 10.222.0.71 () {56 vars in 1074 bytes} [Fri Aug 26 08:49:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:49:25.380185 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-a7220a51-9f1d-42f7-abda-db4c6e7debb2 admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:49:25.383693 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-a7220a51-9f1d-42f7-abda-db4c6e7debb2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:49:25.384109 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-a7220a51-9f1d-42f7-abda-db4c6e7debb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:49:25.384541 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-a7220a51-9f1d-42f7-abda-db4c6e7debb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:49:25.385259 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-a7220a51-9f1d-42f7-abda-db4c6e7debb2 admin admin] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:49:25.385703 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-a7220a51-9f1d-42f7-abda-db4c6e7debb2 admin admin] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:49:25.386117 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-a7220a51-9f1d-42f7-abda-db4c6e7debb2 admin admin] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:49:25.406345 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-a7220a51-9f1d-42f7-abda-db4c6e7debb2 admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080048 Aug 26 08:49:25.407751 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 37/72] 10.222.0.71 () {60 vars in 1193 bytes} [Fri Aug 26 08:49:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:49:36.844873 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-3d77616e-407d-45ec-b8e2-7b06cc09abe3 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:49:36.845933 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-3d77616e-407d-45ec-b8e2-7b06cc09abe3 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Aug 26 08:49:36.846334 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 36/73] 10.222.0.71 () {56 vars in 1074 bytes} [Fri Aug 26 08:49:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:49:36.995644 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG dbcounter [-] [117189] Writing DB stats nova_cell0:SELECT=4 {{(pid=117189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:49:36.996403 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG dbcounter [-] [117189] Writing DB stats nova_cell1:SELECT=4 {{(pid=117189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:49:36.997218 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG dbcounter [-] [117189] Writing DB stats nova_api:SELECT=8 {{(pid=117189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:49:37.056330 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-6daf65c5-9858-4b86-a3b4-3d3713fc09db admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:49:37.060181 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-6daf65c5-9858-4b86-a3b4-3d3713fc09db admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:49:37.060705 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-6daf65c5-9858-4b86-a3b4-3d3713fc09db admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:49:37.061168 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-6daf65c5-9858-4b86-a3b4-3d3713fc09db admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:49:37.061910 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-6daf65c5-9858-4b86-a3b4-3d3713fc09db admin admin] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:49:37.062465 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-6daf65c5-9858-4b86-a3b4-3d3713fc09db admin admin] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:49:37.062973 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-6daf65c5-9858-4b86-a3b4-3d3713fc09db admin admin] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:49:37.088791 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-6daf65c5-9858-4b86-a3b4-3d3713fc09db admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.097752 Aug 26 08:49:37.089372 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 38/74] 10.222.0.71 () {60 vars in 1193 bytes} [Fri Aug 26 08:49:36 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:49:37.930730 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: DEBUG nova.api.openstack.wsgi [None req-3d77616e-407d-45ec-b8e2-7b06cc09abe3 admin admin] Calling method '>' {{(pid=117190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:49:37.931769 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: INFO nova.api.openstack.requestlog [None req-3d77616e-407d-45ec-b8e2-7b06cc09abe3 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 26 08:49:37.932255 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: [pid: 117190|app: 0|req: 37/75] 10.222.0.71 () {56 vars in 1074 bytes} [Fri Aug 26 08:49:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:49:38.139854 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG nova.api.openstack.wsgi [None req-d705e68c-505f-4c70-bec7-4d35f6845456 admin admin] Calling method '>' {{(pid=117189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:49:38.143544 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-d705e68c-505f-4c70-bec7-4d35f6845456 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:49:38.144020 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-d705e68c-505f-4c70-bec7-4d35f6845456 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:49:38.144441 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-d705e68c-505f-4c70-bec7-4d35f6845456 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:49:38.145199 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-d705e68c-505f-4c70-bec7-4d35f6845456 admin admin] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:49:38.145633 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-d705e68c-505f-4c70-bec7-4d35f6845456 admin admin] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:49:38.146038 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: DEBUG oslo_concurrency.lockutils [None req-d705e68c-505f-4c70-bec7-4d35f6845456 admin admin] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:49:38.167834 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: INFO nova.api.openstack.requestlog [None req-d705e68c-505f-4c70-bec7-4d35f6845456 admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.097539 Aug 26 08:49:38.168435 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: [pid: 117189|app: 0|req: 39/76] 10.222.0.71 () {60 vars in 1193 bytes} [Fri Aug 26 08:49:38 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:50:37.184951 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: Fri Aug 26 08:50:37 2022 - graceful shutdown triggered... Aug 26 08:50:37.185578 dv-cinder-852364-5-iscsi devstack@n-api.service[117190]: Gracefully killing worker 2 (pid: 117190)... Aug 26 08:50:37.185056 dv-cinder-852364-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 26 08:50:37.186404 dv-cinder-852364-5-iscsi devstack@n-api.service[117189]: Gracefully killing worker 1 (pid: 117189)... Aug 26 08:50:38.186336 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: worker 1 buried after 1 seconds Aug 26 08:50:38.186336 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: worker 2 buried after 1 seconds Aug 26 08:50:38.186336 dv-cinder-852364-5-iscsi devstack@n-api.service[117188]: goodbye to uWSGI. Aug 26 08:50:38.188352 dv-cinder-852364-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 26 08:50:38.188929 dv-cinder-852364-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 26 08:50:38.191916 dv-cinder-852364-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 08:50:38.201723 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 08:50:38.203834 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 08:50:38 2022] *** Aug 26 08:50:38.203834 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 08:50:38.203834 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 08:50:38.203834 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: nodename: dv-cinder-852364-5-iscsi Aug 26 08:50:38.203834 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: machine: x86_64 Aug 26 08:50:38.203834 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: clock source: unix Aug 26 08:50:38.203834 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: pcre jit disabled Aug 26 08:50:38.203834 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: detected number of CPU cores: 4 Aug 26 08:50:38.203834 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: current working directory: / Aug 26 08:50:38.203834 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: detected binary path: /usr/bin/uwsgi-core Aug 26 08:50:38.204620 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: your processes number limit is 47680 Aug 26 08:50:38.204620 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: your memory page size is 4096 bytes Aug 26 08:50:38.204620 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: detected max file descriptor number: 2048 Aug 26 08:50:38.204620 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: lock engine: pthread robust mutexes Aug 26 08:50:38.204620 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: thunder lock: enabled Aug 26 08:50:38.204620 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 08:50:38.204620 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 08:50:38.244211 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: Python main interpreter initialized at 0x56292b59d9c0 Aug 26 08:50:38.244211 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: python threads support enabled Aug 26 08:50:38.244211 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: your server socket listen backlog is limited to 100 connections Aug 26 08:50:38.244211 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: your mercy for graceful operations on workers is 90 seconds Aug 26 08:50:38.244800 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 08:50:38.244800 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: *** Operational MODE: preforking *** Aug 26 08:50:38.247271 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: *** uWSGI is running in multiple interpreter mode *** Aug 26 08:50:38.247271 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: spawned uWSGI master process (pid: 132205) Aug 26 08:50:38.247271 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: spawned uWSGI worker 1 (pid: 132217, cores: 1) Aug 26 08:50:38.247271 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: spawned uWSGI worker 2 (pid: 132218, cores: 1) Aug 26 08:50:38.247271 dv-cinder-852364-5-iscsi devstack@n-api.service[132205]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 08:50:38.245145 dv-cinder-852364-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 08:50:38.918265 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 08:50:38.920382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 08:50:40.078355 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 08:50:40.078355 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: from cryptography.utils import int_from_bytes Aug 26 08:50:40.079124 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 08:50:40.079124 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: from cryptography.utils import int_from_bytes Aug 26 08:50:40.099687 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 08:50:40.099687 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: from cryptography.utils import int_from_bytes Aug 26 08:50:40.100428 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 08:50:40.100428 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: from cryptography.utils import int_from_bytes Aug 26 08:50:42.559020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 08:50:42.559635 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 08:50:42.559727 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 08:50:42.560051 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 08:50:42.560299 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 08:50:42.560727 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.561050 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.563181 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.563181 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.563181 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.563181 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.563181 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.564089 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.564089 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.564398 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.564885 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.565457 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-5-iscsi {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.566030 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.566572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.567156 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.567656 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.568187 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.568748 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.569227 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.569901 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.572051 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.572051 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.572051 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.572687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.573203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.573742 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.574283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.574807 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.575388 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.575938 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.576665 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-5-iscsi {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.577225 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.577849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.578408 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.579215 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.579772 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.580287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.580785 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.581284 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.581739 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.582220 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.582690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.583221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.583689 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.583880 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 08:50:42.584567 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 08:50:42.584720 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.584878 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 08:50:42.585020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.585179 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 08:50:42.585328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.585481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 08:50:42.585620 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.585778 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.585962 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.586433 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.586713 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.587054 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.587323 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.587585 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.587835 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.588091 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.588091 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.588580 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.588815 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.588815 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.589316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.589545 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.589545 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.590043 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.590304 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-5-iscsi {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.590304 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.590835 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.591142 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.591142 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.591622 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.591868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.592111 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.592371 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.592371 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.592835 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.593082 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.593368 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.593641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.593641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.594204 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.596672 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.596672 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.597178 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.597431 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.597695 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.597947 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.597947 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.598410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.598670 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.598670 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.599188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.599441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.599441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.599935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.600191 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-5-iscsi {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.600434 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.600679 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.600679 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.601222 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.601479 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.601738 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.602022 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.602022 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.602477 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.602724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.602724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.603324 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.603557 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.603557 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.604002 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.604280 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.604280 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.604860 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.605108 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.605108 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.605600 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.607015 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.607015 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.607510 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.607760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.608015 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.608268 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.608268 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.608740 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.609099 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.609099 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.609099 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.609820 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.610125 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.610125 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.610613 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.610861 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.610861 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.611498 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.611748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.611748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.612216 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.612466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.612721 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.612967 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.612967 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.613424 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.613691 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.613691 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.614165 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.614405 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.614405 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.615359 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.615609 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.615609 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.616490 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.617380 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.617380 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.617913 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.618150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.618397 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.618646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.618646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.619129 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.619373 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.619373 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.619841 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.620101 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.620101 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.620570 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.620817 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.620817 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.621348 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.621595 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.621831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.622078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.622078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.622540 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.622914 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.622914 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.623381 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.623688 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.623688 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.624140 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.624404 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.624404 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.624936 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.625187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.625187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.625766 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.626017 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.626017 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.627096 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.627713 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.627713 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.628204 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.628450 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.628684 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.628942 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.628942 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.629397 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.629652 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.629652 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.630112 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.630369 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.630369 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.630808 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.631108 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.631108 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.631614 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.631860 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.631860 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.632346 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.632610 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.632610 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.633069 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.633314 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.633314 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.633774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.634029 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.634281 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.634515 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.634515 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.635018 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.635283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.635283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.635895 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.636139 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.636139 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.637042 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.638094 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.638094 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.638563 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.638814 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.638814 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.639441 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.639714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.639714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.640184 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.640441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.640694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.640928 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.640928 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.641480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.641761 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.641761 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.642224 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.642457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.642457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.643000 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.643738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.643738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.644204 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.644455 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.644455 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.645208 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.645445 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.645445 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.646555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.647679 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.647679 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.648695 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.648953 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.649192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.649439 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.649439 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.649911 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.650153 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.650153 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.650620 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.650862 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.651161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.651409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.651409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.651953 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.652188 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.652188 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.652642 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.652886 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.652886 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.653350 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.653583 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.653583 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.654045 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.654295 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.654295 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.654735 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.655031 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.655291 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.655538 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.655538 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.656072 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.656438 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.656438 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.656928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.657606 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.657606 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.658805 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.659092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.659092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.659576 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.659822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.660057 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 08:50:42.660301 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.660301 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.660768 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.661006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.661006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.661487 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.661785 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.661785 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.662254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.662525 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.662525 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.664429 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.664719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.664719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.665214 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.665473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.665473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.665950 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.666202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.666202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.666787 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.667075 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.667075 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.667975 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.668490 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.668490 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.669391 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.669645 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.669645 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.670136 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.671183 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.671465 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.671731 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.671731 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.672251 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.672503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.672503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.672961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.673313 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.673313 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.673844 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.674091 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.674091 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.674686 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.674970 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.674970 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.675660 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.675913 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.675913 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.676403 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.676654 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.677037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.677289 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.677710 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.678225 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.678225 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.679329 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.679758 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.679758 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.680224 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.680499 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.680499 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.680981 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.681230 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.681230 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.681689 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.681994 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.681994 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.682457 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.682695 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.682695 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.683261 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.683512 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.683512 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.684001 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.684251 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.684251 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.684719 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.684979 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.684979 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.685433 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.685681 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.685681 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.686130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.686376 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.686633 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.686996 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.686996 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.687679 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.688072 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.688072 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.689168 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.689743 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.689743 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.690371 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.690639 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.690639 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.691198 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.691663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.691663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.692224 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.692485 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.692485 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.692966 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.693224 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.693762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.694026 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.694026 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.694535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.694780 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.694780 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.695340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.695586 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.695586 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.696066 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.696330 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.696330 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.696820 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.697076 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.697076 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.699008 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.699265 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.700827 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.701116 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.701116 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.701641 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.701999 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.701999 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.702529 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.702823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.702823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.703353 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.703598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.703598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.704048 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.704210 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.704210 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.704515 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.704669 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.704669 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.704953 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.705113 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.705272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.705412 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.705412 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.705665 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.705799 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.705799 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.706076 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.706222 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.706222 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.706514 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.706663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.706663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.706984 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.707139 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.707293 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.707441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.707441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.708058 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.708208 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.708208 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.708480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.708617 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.708617 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.709310 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.709460 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.709460 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.709721 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.709869 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.709869 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.710207 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.710345 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.710345 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.711095 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.711242 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.711399 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.711537 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.711537 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.711797 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.711932 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.711932 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.712206 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.712413 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.712413 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.712715 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.712851 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.712851 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.713118 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.713271 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.713416 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.713549 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.713549 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.713797 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.713948 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.713948 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.714214 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.714350 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.714350 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.714631 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.714770 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.714770 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.715065 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.715202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.715202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.715485 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.715621 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.715621 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.715898 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.716034 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.716034 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.716306 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.716443 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.716588 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.716736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.716736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.716992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.717141 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.717141 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.717398 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.717533 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.717533 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.717944 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.718095 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.718095 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.719424 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.719565 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.719720 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.719896 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.719896 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.720211 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.720364 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.720364 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.720626 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.720777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.720956 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.721543 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.721543 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.721809 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.721959 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.721959 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.722225 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.722426 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.722426 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.722693 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.722844 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.722844 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.723160 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.723297 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.723297 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.723542 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.723700 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.723700 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.723973 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.724126 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.724126 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.724387 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.724544 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.724691 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.724828 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.724828 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.725103 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.725250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.725250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.725533 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.725668 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.725668 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.725930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.726144 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.726282 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.726418 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.726554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.726687 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.726687 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.726997 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.727138 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.727138 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.727403 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.727568 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.727568 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.727836 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.727983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.727983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.728263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.728401 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.728401 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.728664 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.728809 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.728981 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.730475 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.730475 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.730747 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.730909 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.730909 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.731204 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.731733 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.731733 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.732015 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.732151 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.732151 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.732427 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.732911 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.732911 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.733187 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.733344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.733344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.733615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.733752 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.733752 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.734053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.734193 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.734193 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.734488 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.734627 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.734627 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.734968 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.735109 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.735109 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.735386 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.735531 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.735679 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.735826 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.735962 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.736095 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.736095 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.736367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.736503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.736503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.736753 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.736912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.736912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.737169 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.737316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.737316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.737575 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.737723 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.737723 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.737984 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.738118 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.738253 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.738399 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.738549 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.738683 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.738683 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.738953 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.738953 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.738953 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.740087 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.740087 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.740364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.740542 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.740677 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.740828 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.740828 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.741087 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.741223 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.741223 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.742080 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.742239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.742239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.742491 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.742711 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.742711 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.743000 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.743160 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.743310 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.743459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.743459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.743733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.743880 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.743880 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.744203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.744352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.744489 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.744635 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.744635 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.744916 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.745064 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.745064 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.745321 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.745469 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.745469 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.745739 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.745876 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.746046 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.746195 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.746195 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.746475 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.746621 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.746621 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.746876 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.747030 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.747030 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.747301 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.747448 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.747448 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.747711 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.747860 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.747860 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.748383 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.748526 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.748676 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.748821 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.748821 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.749087 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.749234 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.749234 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.749564 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.750099 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.750099 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.750373 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.750508 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.750508 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.750778 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.751086 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.751086 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.751459 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.751459 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.752287 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.752446 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.752597 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.752824 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.752974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.752974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.753238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.753387 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.753524 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.753681 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.753681 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.753939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.754093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.754093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.754339 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.754497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.754497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.754768 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.754927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.754927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.755195 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.755350 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.755499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.755657 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.755657 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.755933 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.756093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.756093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.756351 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.756486 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.756486 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.756737 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.756894 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.757029 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.757175 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.757175 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.757449 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.757598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.757598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.757863 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.757998 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.757998 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.758245 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.758393 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.758393 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.758755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.758925 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.758925 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.759193 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.759330 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.759480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.759626 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.759626 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.760257 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.760402 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.760402 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.760688 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.760826 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.760977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.761124 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.761124 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.761388 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.761547 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.761547 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.761805 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.761971 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.761971 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.762816 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.762979 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.763137 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.763287 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.763287 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.763549 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.763701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.763701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.763973 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.764110 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.764110 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.764376 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.764523 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.764523 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.764774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.764923 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.765096 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.765258 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.765258 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.765522 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.765678 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.765678 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.765947 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.766104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.766104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.766365 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.766504 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.767720 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.767883 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.767883 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.768159 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.768299 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.768455 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.768588 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.768588 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.768866 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.769002 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.769002 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.769275 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.769425 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.769570 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.769710 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.769710 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.769987 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.770159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.770159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.770786 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.771070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.771070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.771443 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.771599 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.771749 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.771886 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.771886 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.772188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.772986 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.772986 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.773257 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.773395 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.773395 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.773660 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.773876 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.774037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.774175 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.774175 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.774446 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.774609 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.774609 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.774609 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.775018 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.775157 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.775157 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.775438 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.775914 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.775914 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.776192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.776334 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.776334 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.776595 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.776734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.776872 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.777011 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.777011 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.777294 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.777445 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.777601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.777750 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.777750 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.778023 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.778157 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.778157 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.778406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.778542 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.778542 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.778822 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.778989 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.778989 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.779255 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.779394 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.779394 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.779671 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.779807 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.779944 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.780104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.780104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.780393 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.780992 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.780992 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.781247 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.781395 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.781395 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.781661 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.781809 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.781809 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.782058 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.782206 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.782375 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.782554 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.782554 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.783747 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.783900 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.783900 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.784174 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.784310 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.784456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.784612 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.784612 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.784910 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.785065 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.785065 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.785347 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.785515 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.785714 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.785873 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.785873 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.786126 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.786281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.786443 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.786608 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.786608 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.786940 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.787085 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.787085 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.787335 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.787502 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.787502 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.787775 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.787914 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.787914 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.788183 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.788455 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.788455 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.788745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.788927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.788927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.789234 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.789409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.789573 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.789738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.789738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.790047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.790202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.790202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.790499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.790675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.790675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.791257 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.791441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.791441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.791746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.791901 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.791901 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.792183 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.792352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.792516 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.792669 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.792669 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.792949 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.793135 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.793135 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.793637 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.793797 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.793972 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.794135 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.794300 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.794468 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.794468 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.794749 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.794962 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.794962 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.795287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.795451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.795615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.795777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.795777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.796057 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.796235 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.796235 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.796560 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.796729 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.796729 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.797034 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.797203 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.797203 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.797496 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.797659 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.797812 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.797985 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.797985 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.798280 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.798433 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.798433 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.798749 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.798947 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.799112 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.799291 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.799291 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.799582 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.799744 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.799744 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.800021 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.800183 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.800183 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.800467 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.800604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.800604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.800863 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.801027 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.801399 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.801565 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.801565 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.801869 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.802075 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.802231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.802398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.802398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.802682 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.802848 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.802848 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.803294 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.803469 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.803713 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.803879 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.803879 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.804178 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.804342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.804342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.804636 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.804815 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.804980 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.805132 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.805132 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.805437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.805591 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.805591 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.805882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.806045 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.806045 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.806360 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.806525 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.806689 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.806844 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.806844 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.807185 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.807338 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.807338 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.807638 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.807832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.807832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.808140 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.808307 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.808307 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.808651 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.808807 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.808960 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.809128 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.809128 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.809441 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.809604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.809767 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.809937 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.809937 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.810374 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.810541 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.810690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.810835 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.810835 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.811488 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.811648 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.811648 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.811987 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.812176 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.812176 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.812490 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.812645 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.812645 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.812936 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.813100 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.813274 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.813427 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.813427 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.813783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.813928 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.813928 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.814230 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.814384 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.814384 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.814687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.814839 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.814839 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.815159 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.815316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.815316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.815608 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.815760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.815931 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.816070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.816070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.816314 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.816443 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.816443 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.816665 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.816813 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.816813 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.817074 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.817226 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.817226 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.817514 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.817663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.817663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.817933 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.818070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.818070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.818353 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.818497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.818645 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.818795 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.818795 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.819139 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.819277 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.819277 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.819537 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.819673 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.819673 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.819935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.820071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.820233 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.820385 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.820523 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.820673 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.820673 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.820922 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.821072 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.821072 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.821331 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.823497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.823497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.823826 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.823996 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.824138 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.824278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.824278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.824575 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.824740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.824740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.825034 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.825187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.825187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.825493 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.825651 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.825651 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.825956 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.826126 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.826126 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.826464 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.826625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.826773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.827014 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.827014 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.827298 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.827437 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.827437 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.827719 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.827869 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.827869 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.828172 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.828325 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.828325 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.828623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.828796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.828796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.829088 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.829253 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.829419 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.829589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.829589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.829896 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.830050 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.830050 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.830309 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.830455 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.830455 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.830768 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.830945 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.831111 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.831268 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.831268 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.831581 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.832034 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.832034 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.832315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.832473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.832473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.832473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.832473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.832473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.832473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.833290 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.833461 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.833461 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.833747 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.833963 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.834113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.834279 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.834279 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.834588 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.834748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.834748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.835075 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.835252 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.835252 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.835546 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.835700 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.835700 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.835991 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.836165 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.836165 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.836450 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.836601 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.836601 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.836894 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.837065 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.837231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.837384 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.837384 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.837680 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.837832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.837832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.838129 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.838293 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.838293 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.838293 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.838726 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.838880 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.838880 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.839313 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.839468 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.839468 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.839781 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.839936 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.839936 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.840229 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.840382 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.840568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.840733 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.840733 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.840995 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.841133 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.841133 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.841395 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.841665 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.841665 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.841984 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.842173 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.842173 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.842173 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.842620 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.842772 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.842772 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.843071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.843264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.843264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.843573 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.843738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.843738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.844195 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.844365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.844365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.844672 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.844827 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.844827 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.845120 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.845286 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.845286 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.845586 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.845738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.845738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.846071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.846232 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.846232 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.846513 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.846679 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.846843 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.847030 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.847030 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.847349 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.847504 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.847504 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.847822 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.847984 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.847984 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.848290 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.848442 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.848442 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.848733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.848908 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.848908 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.849188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.849339 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.849339 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.849631 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.849806 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.849806 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.850102 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.850259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.850259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.850552 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.850728 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.850728 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.851058 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.851222 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.851377 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.851554 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.851554 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.851851 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.851995 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.851995 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.852300 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.852467 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 08:50:42.852622 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.852622 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.852622 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.852622 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.852622 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.852622 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.852622 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.852622 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.853708 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.853708 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.853708 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.853708 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.853708 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.853708 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.853708 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.853708 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.854857 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.854857 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.854857 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.854857 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.854857 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.854857 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.854857 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.855958 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.856330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.856740 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.857161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.857575 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.857993 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.858397 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.859962 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.860423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.860847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.861280 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.861718 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.862148 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.862607 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.863057 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.863485 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.864229 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.864614 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.865638 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.865978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.866460 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.867000 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.867382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.867820 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.868254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.868673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.869112 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.869544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.869974 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.870400 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.870826 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.871261 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.871669 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.872098 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.872515 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.872924 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.873333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.873819 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.874214 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.874775 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.875227 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.875733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.876168 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.876604 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.877048 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.877461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.877870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.878281 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.878730 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.879183 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.879615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.880038 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.880468 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.880885 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.881300 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.881722 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.882138 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.882565 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.883035 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.883461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.883877 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.884297 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.884825 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.885274 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.885972 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.886410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.886833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.887295 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.887724 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.888142 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.888555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.889099 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.889591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.890008 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.890551 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.891227 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.891613 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.892087 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.892676 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.893102 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.893572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.894029 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.894518 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.895097 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.895642 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.896106 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.896570 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.897031 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.897574 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.897993 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.898497 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.898947 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.899414 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.899836 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.900251 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.900668 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.901092 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.901580 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.902089 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.902566 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.903071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO dbcounter [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] Registered counter for database nova_api Aug 26 08:50:42.903249 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.903644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.904107 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.904997 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.905553 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.906012 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.906415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.906988 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.907338 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.907747 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.908194 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.908786 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.909269 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.909600 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.910053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.910415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.910840 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.911375 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.911799 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.912297 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.912724 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.913539 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.913995 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.914423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.914861 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.915385 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.915883 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.916310 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.916735 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.917211 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.917630 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.918052 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.918469 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.919025 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.919545 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.920064 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.922442 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.922442 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.922442 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.922442 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.922840 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.923065 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.923544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.924009 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.924469 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.924919 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.925374 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.925789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.926248 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.926615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.926838 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_db.sqlalchemy.engines [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:50:42.927327 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.927682 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.928097 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.928519 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.928931 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.929353 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.929810 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.930254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.930667 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.931143 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.931662 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.932082 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.932517 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.933070 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.933485 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writer thread running {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:50:42.933669 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.934083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.934920 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.935479 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.936034 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.936569 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.937152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.937720 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.938587 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.938962 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.939494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.940068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.940606 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.941156 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.941823 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.942352 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.943890 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.943890 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.944088 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.944473 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.944993 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.945517 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.946047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.946580 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.947145 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.947687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.948253 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.948849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.949397 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.949942 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.950481 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.951062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.951586 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.952118 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.952684 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.953235 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.953782 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.954344 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.954905 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.955446 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.956176 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.956713 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.957266 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.957817 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.958368 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.958976 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.959495 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.960037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.960588 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.961123 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.961699 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.962279 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.962835 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.963492 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.964025 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.965533 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.965533 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.965745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.966210 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.966742 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.967292 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.967828 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.968405 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.968934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.971034 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.971034 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.971034 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.971034 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.971739 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.972047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.972560 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.973092 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.973635 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.974164 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.974692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.975753 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.976275 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.976805 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.977343 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.977887 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.978461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.979062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.979605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.980164 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.980703 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.981261 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.981799 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.982351 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.982957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.983476 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.984067 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.984665 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.985199 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.985733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.986290 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.986828 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.987405 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.987924 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.988500 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.989047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.989578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.990467 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.991030 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.991584 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.992143 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.992678 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.993247 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.993790 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.994333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.994871 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.995442 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.995961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.996510 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.997042 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.997581 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.998123 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.998665 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.999262 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:42.999845 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:43.000384 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:43.000964 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:43.001524 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:43.002118 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:43.002672 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:43.003305 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:43.003880 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:43.004416 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:43.004960 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:43.005521 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 08:50:43.005895 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 08:50:43.035316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.context [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ca95b6a2-7122-49b3-ad9d-53c968d985a7(cell1) {{(pid=132218) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 08:50:43.042823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:50:43.043620 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:50:43.046688 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:50:43.047945 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:50:43.048665 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:50:43.052289 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:50:43.055842 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO dbcounter [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] Registered counter for database nova_cell0 Aug 26 08:50:43.063482 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO dbcounter [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] Registered counter for database nova_cell1 Aug 26 08:50:43.074496 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_db.sqlalchemy.engines [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:50:43.077915 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_db.sqlalchemy.engines [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:50:43.090381 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writer thread running {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:50:43.090920 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writer thread running {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:50:43.119575 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO dbcounter [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] Registered counter for database nova_api Aug 26 08:50:43.153084 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_db.sqlalchemy.engines [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:50:43.161440 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writer thread running {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:50:43.219318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.context [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ca95b6a2-7122-49b3-ad9d-53c968d985a7(cell1) {{(pid=132217) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 08:50:43.222595 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:50:43.223115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:50:43.224722 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:50:43.225466 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:50:43.225921 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:50:43.227957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:50:43.230004 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO dbcounter [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] Registered counter for database nova_cell0 Aug 26 08:50:43.234108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO dbcounter [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] Registered counter for database nova_cell1 Aug 26 08:50:43.241828 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_db.sqlalchemy.engines [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:50:43.245568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_db.sqlalchemy.engines [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:50:43.248619 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writer thread running {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:50:43.263504 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO dbcounter [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] Registered counter for database nova_cell0 Aug 26 08:50:43.270611 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_db.sqlalchemy.engines [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:50:43.275755 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writer thread running {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:50:43.388971 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writer thread running {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:50:43.399162 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO dbcounter [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] Registered counter for database nova_cell0 Aug 26 08:50:43.408470 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_db.sqlalchemy.engines [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 08:50:43.413058 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writer thread running {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 08:50:43.592139 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: WARNING keystonemiddleware.auth_token [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 08:50:43.599675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: WARNING keystonemiddleware.auth_token [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 08:50:43.730097 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: WARNING keystonemiddleware.auth_token [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 08:50:43.738027 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: WARNING keystonemiddleware.auth_token [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 08:50:43.980920 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: WARNING keystonemiddleware.auth_token [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 08:50:43.988133 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: WARNING keystonemiddleware.auth_token [None req-dbcd7909-3934-4e30-b18a-334c75466853 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 08:50:43.994413 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56292b59d9c0 pid: 132218 (default app) Aug 26 08:50:44.095014 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: WARNING keystonemiddleware.auth_token [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 08:50:44.101998 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: WARNING keystonemiddleware.auth_token [None req-b265a8c2-da49-4cde-87c7-51381874c6ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 08:50:44.107495 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56292b59d9c0 pid: 132217 (default app) Aug 26 08:51:26.901651 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=3 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:26.905843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=3 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:26.908917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=3 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:26.911272 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=3 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:29.056444 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-09acc8c4-fa54-4fa2-a31a-be46ba00ea6b tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] Action: 'create', calling method: .version_select at 0x7f136cf84a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1252914189", "metadata": {"Type": "work"}}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:51:31.317742 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-09acc8c4-fa54-4fa2-a31a-be46ba00ea6b tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.437829 Aug 26 08:51:31.319828 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 1/1] 10.222.0.71 () {60 vars in 1156 bytes} [Fri Aug 26 08:51:26 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4442 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 26 08:51:31.349391 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=3 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:31.354877 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=3 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:31.359771 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=3 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:31.364820 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=3 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:31.933456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-96c42e0c-9e39-48be-a7d4-ed52144ebc47 tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] Calling method '.version_select at 0x7f136cfd6550>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:51:32.822416 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-96c42e0c-9e39-48be-a7d4-ed52144ebc47 tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/09c19276-195d-4fb6-b749-3c6a455f2f95" status: 200 len: 354 microversion: 2.1 time: 1.480283 Aug 26 08:51:32.833238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 1/2] 10.222.0.71 () {58 vars in 1245 bytes} [Fri Aug 26 08:51:31 2022] GET /compute/v2.1/os-volumes/09c19276-195d-4fb6-b749-3c6a455f2f95 => generated 354 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:51:32.841433 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4e35aa64-27c9-4767-9698-41933e011900 tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] Calling method '.version_select at 0x7f136ce578b0>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:51:33.048080 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4e35aa64-27c9-4767-9698-41933e011900 tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/09c19276-195d-4fb6-b749-3c6a455f2f95" status: 200 len: 354 microversion: 2.1 time: 0.214411 Aug 26 08:51:33.048838 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 2/3] 10.222.0.71 () {58 vars in 1245 bytes} [Fri Aug 26 08:51:32 2022] GET /compute/v2.1/os-volumes/09c19276-195d-4fb6-b749-3c6a455f2f95 => generated 354 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:51:33.083193 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-5d5b2554-ba22-45b8-a56e-d7c25acef58c tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] Calling method '.version_select at 0x7f136ce96820>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:51:33.492709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-5d5b2554-ba22-45b8-a56e-d7c25acef58c tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/09c19276-195d-4fb6-b749-3c6a455f2f95" status: 202 len: 0 microversion: 2.1 time: 0.420953 Aug 26 08:51:33.494116 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 2/4] 10.222.0.71 () {58 vars in 1248 bytes} [Fri Aug 26 08:51:33 2022] DELETE /compute/v2.1/os-volumes/09c19276-195d-4fb6-b749-3c6a455f2f95 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:51:33.507865 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4aa742e6-b4d1-4f06-b695-8f46ca5065ed tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] Calling method '.version_select at 0x7f136ce57f70>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:51:33.792208 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4aa742e6-b4d1-4f06-b695-8f46ca5065ed tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/09c19276-195d-4fb6-b749-3c6a455f2f95" status: 200 len: 353 microversion: 2.1 time: 0.291261 Aug 26 08:51:33.794017 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 3/5] 10.222.0.71 () {58 vars in 1245 bytes} [Fri Aug 26 08:51:33 2022] GET /compute/v2.1/os-volumes/09c19276-195d-4fb6-b749-3c6a455f2f95 => generated 353 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:51:34.820468 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2018422f-f011-4ba0-844c-80d2957c58aa tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] Calling method '.version_select at 0x7f136ce96ee0>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:51:35.039599 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-2018422f-f011-4ba0-844c-80d2957c58aa tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] HTTP exception thrown: Volume 09c19276-195d-4fb6-b749-3c6a455f2f95 could not be found. Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2018422f-f011-4ba0-844c-80d2957c58aa tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] Request method failure captured: Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/os-volumes/09c19276-195d-4fb6-b749-3c6a455f2f95 HTTP/1.1 Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCImOQyPnwWzVG0sgj4rCgcPR0pbCXBqtTCAiiJdeez8MIrAiG-4RFkS11bwvxTlorVv68qQe_eUhcLPHaiOtK4u_V878W5ckKTqAzIAm5cw2eiyKaOuNqIiU6aphWaF2ZqstdEHmXzMq2wARQTvgkKRS_tFJot8sc14Nww4bR4w2k5A Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 0ce8d281891a46a9acbefc09bcd15866 Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-VolumesGetTestJSON-1853806971 Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 08:51:35.054681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 08:51:35.055934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_0ce8d281891a46a9acbefc09bcd15866", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/0ce8d281891a46a9acbefc09bcd15866"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/0ce8d281891a46a9acbefc09bcd15866"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/0ce8d281891a46a9acbefc09bcd15866"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:51:35.055934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-VolumesGetTestJSON-1853806971 Aug 26 08:51:35.055934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 0ce8d281891a46a9acbefc09bcd15866 Aug 26 08:51:35.055934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-VolumesGetTestJSON-1853806971 Aug 26 08:51:35.055934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-VolumesGetTestJSON-1853806971-project Aug 26 08:51:35.055934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 08:51:35.055934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 08:51:35.055934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 2351fbc5fab24fb5baaa9bac9d563a7a Aug 26 08:51:35.055934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-VolumesGetTestJSON-1853806971-project Aug 26 08:51:35.055934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: Aug 26 08:51:35.055934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Volume 09c19276-195d-4fb6-b749-3c6a455f2f95 could not be found. Aug 26 08:51:35.055934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '09c19276-195d-4fb6-b749-3c6a455f2f95'} Aug 26 08:51:35.055934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 09c19276-195d-4fb6-b749-3c6a455f2f95 could not be found. (HTTP 404) (Request-ID: req-6bcef1dd-4792-4d26-8905-78dfeadfb277) Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:51:35.056733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 08:51:35.058083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 09c19276-195d-4fb6-b749-3c6a455f2f95 could not be found. Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 08:51:35.059287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:51:35.060694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 09c19276-195d-4fb6-b749-3c6a455f2f95 could not be found. Aug 26 08:51:35.060694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:51:35.060694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:51:35.060694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:51:35.060694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:51:35.060694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:51:35.060694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:51:35.060694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:51:35.060694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:51:35.060694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 09c19276-195d-4fb6-b749-3c6a455f2f95 could not be found. Aug 26 08:51:35.060694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:51:35.060694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2018422f-f011-4ba0-844c-80d2957c58aa tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] Returning 404 to user: Volume 09c19276-195d-4fb6-b749-3c6a455f2f95 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:51:35.063728 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2018422f-f011-4ba0-844c-80d2957c58aa tempest-VolumesGetTestJSON-1853806971 tempest-VolumesGetTestJSON-1853806971-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/09c19276-195d-4fb6-b749-3c6a455f2f95" status: 404 len: 109 microversion: 2.1 time: 0.256376 Aug 26 08:51:35.075492 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 3/6] 10.222.0.71 () {58 vars in 1245 bytes} [Fri Aug 26 08:51:34 2022] GET /compute/v2.1/os-volumes/09c19276-195d-4fb6-b749-3c6a455f2f95 => generated 109 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:51:45.153374 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-cc2b51d9-5fc6-4dd5-bc94-aff0232cd629 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Action: 'create', calling method: .version_select at 0x7f136ce6f550>, body: {"keypair": {"name": "tempest-keypair-1961307273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOkLksUA16+pkAfiaizjmugnLOwxyUoZX1VdRF4zzFwE+yMMDJNACAu+as3lYsum1DA08hEjI46qvVOXiO3cNEFcoOyf5xzxSttB/PG4C19t68W+KL1ik4WQetnDEEcrw=="}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:51:45.349395 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-cc2b51d9-5fc6-4dd5-bc94-aff0232cd629 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Getting quotas for project 88aa61636dd846f0a95be974b6b99d05. Resources: {'key_pairs'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:51:45.371910 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-cc2b51d9-5fc6-4dd5-bc94-aff0232cd629 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Getting quotas for user b6f722499abc409a8a345bcb70114eaf and project 88aa61636dd846f0a95be974b6b99d05. Resources: {'key_pairs'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:51:45.503992 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-cc2b51d9-5fc6-4dd5-bc94-aff0232cd629 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.137274 Aug 26 08:51:45.506422 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 4/7] 10.222.0.71 () {60 vars in 1159 bytes} [Fri Aug 26 08:51:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:51:50.777545 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-557638909", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "networks": [{"uuid": "b57f5ead-b42e-4bc2-a82c-deb3c7d59ce4"}]}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:51:51.133418 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.network.neutron [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] validate_networks() for [('b57f5ead-b42e-4bc2-a82c-deb3c7d59ce4', None, None, None, None, None)] {{(pid=132217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:51:53.588717 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2104131111", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b89dcda-85d5-4bc7-8c82-22c051e5c000"}], "security_groups": [{"name": "tempest-securitygroup--1178058502"}], "key_name": "tempest-keypair-1961307273", "user_data": "}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:51:54.237321 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.network.neutron [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] validate_networks() for [('7b89dcda-85d5-4bc7-8c82-22c051e5c000', None, None, None, None, None)] {{(pid=132218) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:51:55.417652 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=4 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:51:56.086449 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Flavor limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:51:56.087374 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Image limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:51:56.088370 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Flavor pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:51:56.089068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Image pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:51:56.089893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:51:56.159871 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:51:56.163177 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:51:56.163926 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:51:56.165213 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:51:56.165973 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:51:56.171914 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:51:56.326142 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Getting quotas for project 76bb70b9748b4ed69bfc098327cc1234. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:51:56.357738 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Getting quotas for user d065c8a972df4b8e92996ce27e96b486 and project 76bb70b9748b4ed69bfc098327cc1234. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:51:56.407839 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Going to run 1 instances... {{(pid=132217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:51:56.423426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:51:56.698344 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ea4e48a9-75ed-4b32-b15c-19c43c332d25 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.624975 Aug 26 08:51:56.699658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 4/8] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:51:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 6631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 08:51:57.792716 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d647b1f8-4f36-4e1c-9423-8198d7ccc958 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Action: 'create', calling method: .version_select at 0x7f136c4db430>, body: {"keypair": {"name": "tempest-keypair-1401257981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh1Etf9wU46Mzq2YZmngT62rn/7zycwMt5ytSRp1HvMkk3vbRUTFZ9w0zLP3weqBX5QDYPvTC3+7TkduZ2080KXfEaic7ZcCTgb2E8yiK0JXH5Xan+b7apjwxFSPyj8ng=="}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:51:57.904980 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-d647b1f8-4f36-4e1c-9423-8198d7ccc958 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Getting quotas for project 8ed7993eba324f94a1b0f7fc23401f0f. Resources: {'key_pairs'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:51:57.919745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-d647b1f8-4f36-4e1c-9423-8198d7ccc958 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Getting quotas for user 63e1c5a24be04ca4abd5d5109c5763f8 and project 8ed7993eba324f94a1b0f7fc23401f0f. Resources: {'key_pairs'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:51:58.047677 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d647b1f8-4f36-4e1c-9423-8198d7ccc958 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.343541 Aug 26 08:51:58.055901 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 5/9] 10.222.0.71 () {62 vars in 1200 bytes} [Fri Aug 26 08:51:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1352 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 08:51:58.098693 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-52610028-1703-4a67-888d-272a723966e3 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:51:58.099901 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-52610028-1703-4a67-888d-272a723966e3 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:51:58.901037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-52610028-1703-4a67-888d-272a723966e3 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:51:58.953217 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-52610028-1703-4a67-888d-272a723966e3 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1214 microversion: 2.1 time: 0.894684 Aug 26 08:51:58.968236 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 6/10] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:51:58 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1214 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:51:59.406427 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Flavor limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:51:59.407269 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Image limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:51:59.408009 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Flavor pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:51:59.409368 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Image pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:51:59.410467 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:51:59.479279 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:51:59.480125 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:51:59.491160 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:51:59.492844 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:51:59.494125 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:51:59.495135 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:51:59.717970 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Getting quotas for project 88aa61636dd846f0a95be974b6b99d05. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:51:59.756503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Getting quotas for user b6f722499abc409a8a345bcb70114eaf and project 88aa61636dd846f0a95be974b6b99d05. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:51:59.873684 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Going to run 1 instances... {{(pid=132218) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:51:59.922014 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132218) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:52:00.003236 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-76d25038-6b87-438c-a2de-7b83d1e469c6 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:00.009579 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-76d25038-6b87-438c-a2de-7b83d1e469c6 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:00.186067 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-76d25038-6b87-438c-a2de-7b83d1e469c6 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:00.206493 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-76d25038-6b87-438c-a2de-7b83d1e469c6 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1214 microversion: 2.1 time: 0.211389 Aug 26 08:52:00.212005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 7/11] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:51:59 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:00.246577 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a332ad9f-690e-467e-a2e4-f2d6f8d60574 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.672417 Aug 26 08:52:00.256963 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 5/12] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:51:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 6685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 08:52:00.270541 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f1bca882-b0c6-4890-9efb-5aff8764e258 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:00.271528 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f1bca882-b0c6-4890-9efb-5aff8764e258 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:00.482512 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f1bca882-b0c6-4890-9efb-5aff8764e258 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:00.502066 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f1bca882-b0c6-4890-9efb-5aff8764e258 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1238 microversion: 2.1 time: 0.236813 Aug 26 08:52:00.507415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 8/13] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:00 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1238 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:01.251885 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fad21795-9cd4-43ac-89a9-6c46bfe75789 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:01.253777 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-fad21795-9cd4-43ac-89a9-6c46bfe75789 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:01.309795 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fad21795-9cd4-43ac-89a9-6c46bfe75789 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:01.310360 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fad21795-9cd4-43ac-89a9-6c46bfe75789 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:01.311014 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fad21795-9cd4-43ac-89a9-6c46bfe75789 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:01.311937 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fad21795-9cd4-43ac-89a9-6c46bfe75789 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:01.312531 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fad21795-9cd4-43ac-89a9-6c46bfe75789 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:01.312973 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fad21795-9cd4-43ac-89a9-6c46bfe75789 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:01.387666 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1992212283", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:01.587565 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.network.neutron [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] validate_networks() for [('0095b163-b541-4b8f-a3b6-64656b6e47e8', None, None, None, None, None)] {{(pid=132218) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:52:01.852682 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-fad21795-9cd4-43ac-89a9-6c46bfe75789 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:01.911950 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fad21795-9cd4-43ac-89a9-6c46bfe75789 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1210 microversion: 2.1 time: 0.658740 Aug 26 08:52:01.915221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 9/14] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:01 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1210 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:01.931526 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f3ac340c-3d10-4c9c-b2c3-304d64892225 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:01.936051 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f3ac340c-3d10-4c9c-b2c3-304d64892225 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:02.575763 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f3ac340c-3d10-4c9c-b2c3-304d64892225 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:02.630087 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f3ac340c-3d10-4c9c-b2c3-304d64892225 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1238 microversion: 2.1 time: 0.686910 Aug 26 08:52:02.665893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 10/15] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:01 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1238 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:02.941295 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2df48ad3-1b0d-4379-aa8d-736790873899 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:02.942335 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2df48ad3-1b0d-4379-aa8d-736790873899 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:02.978817 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2df48ad3-1b0d-4379-aa8d-736790873899 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:02.992675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2df48ad3-1b0d-4379-aa8d-736790873899 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:02.995677 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2df48ad3-1b0d-4379-aa8d-736790873899 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:02.999498 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2df48ad3-1b0d-4379-aa8d-736790873899 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:03.003761 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2df48ad3-1b0d-4379-aa8d-736790873899 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:03.009790 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2df48ad3-1b0d-4379-aa8d-736790873899 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:03.583002 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2df48ad3-1b0d-4379-aa8d-736790873899 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:03.636361 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2df48ad3-1b0d-4379-aa8d-736790873899 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1266 microversion: 2.1 time: 0.700692 Aug 26 08:52:03.648733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 11/16] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:02 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1266 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:03.692121 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2124fb8a-7669-4f4c-a6c7-6ab3214d7a1b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:03.698719 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2124fb8a-7669-4f4c-a6c7-6ab3214d7a1b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:03.721633 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2124fb8a-7669-4f4c-a6c7-6ab3214d7a1b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:03.723165 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2124fb8a-7669-4f4c-a6c7-6ab3214d7a1b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:03.724027 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2124fb8a-7669-4f4c-a6c7-6ab3214d7a1b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:03.725893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2124fb8a-7669-4f4c-a6c7-6ab3214d7a1b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:03.726945 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2124fb8a-7669-4f4c-a6c7-6ab3214d7a1b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:03.728768 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2124fb8a-7669-4f4c-a6c7-6ab3214d7a1b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:03.969871 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2124fb8a-7669-4f4c-a6c7-6ab3214d7a1b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:03.998298 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2124fb8a-7669-4f4c-a6c7-6ab3214d7a1b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1234 microversion: 2.1 time: 0.341872 Aug 26 08:52:04.000087 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 12/17] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:03 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1234 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:04.256103 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Flavor limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:52:04.256810 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Image limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:52:04.256977 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Flavor pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:52:04.257380 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Image pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:52:04.257854 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:52:04.282780 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:04.283980 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:04.283980 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:04.284487 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:04.284938 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:04.285368 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:04.349582 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Getting quotas for project 01d9fa7bc7124476aa295e69b120becd. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:52:04.385222 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Getting quotas for user 3aced0ed17b946f9961d87a1d4446c37 and project 01d9fa7bc7124476aa295e69b120becd. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:52:04.451103 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Going to run 1 instances... {{(pid=132218) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:52:04.455187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132218) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:52:04.609735 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c60f30db-03da-423b-a423-d2c7b504d527 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.297457 Aug 26 08:52:04.624405 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d5d36f9f-4442-4927-b978-fef68b8b6a9a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:04.629854 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d5d36f9f-4442-4927-b978-fef68b8b6a9a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:04.635398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 6/18] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:52:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 4325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 08:52:04.685267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-712ca5d0-bf56-49cd-a296-ef45cb002846 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:04.686025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-712ca5d0-bf56-49cd-a296-ef45cb002846 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:04.745797 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-712ca5d0-bf56-49cd-a296-ef45cb002846 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:04.746307 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-712ca5d0-bf56-49cd-a296-ef45cb002846 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:04.746751 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-712ca5d0-bf56-49cd-a296-ef45cb002846 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:04.753800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-712ca5d0-bf56-49cd-a296-ef45cb002846 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:04.763637 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-712ca5d0-bf56-49cd-a296-ef45cb002846 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:04.764311 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-712ca5d0-bf56-49cd-a296-ef45cb002846 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:04.930538 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d5d36f9f-4442-4927-b978-fef68b8b6a9a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:04.945886 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d5d36f9f-4442-4927-b978-fef68b8b6a9a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1222 microversion: 2.1 time: 0.326074 Aug 26 08:52:04.951550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 13/19] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:04 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1222 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:52:05.025582 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-12b9d9d4-0684-403b-921b-af9578cfd297 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:05.026799 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-12b9d9d4-0684-403b-921b-af9578cfd297 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:05.045390 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-12b9d9d4-0684-403b-921b-af9578cfd297 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:05.050914 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-12b9d9d4-0684-403b-921b-af9578cfd297 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:05.054805 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-12b9d9d4-0684-403b-921b-af9578cfd297 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:05.059780 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-12b9d9d4-0684-403b-921b-af9578cfd297 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:05.078048 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-12b9d9d4-0684-403b-921b-af9578cfd297 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:05.084656 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-12b9d9d4-0684-403b-921b-af9578cfd297 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:05.396075 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-12b9d9d4-0684-403b-921b-af9578cfd297 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:05.421193 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-12b9d9d4-0684-403b-921b-af9578cfd297 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1298 microversion: 2.1 time: 0.394269 Aug 26 08:52:05.421837 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 14/20] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:05 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1298 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:52:05.473129 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-774469418", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:05.660970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.network.neutron [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] validate_networks() for [('0095b163-b541-4b8f-a3b6-64656b6e47e8', None, None, None, None, None)] {{(pid=132217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:52:05.837804 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-712ca5d0-bf56-49cd-a296-ef45cb002846 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:05.901307 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-712ca5d0-bf56-49cd-a296-ef45cb002846 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1272 microversion: 2.1 time: 1.222349 Aug 26 08:52:05.908657 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 7/21] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:04 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1272 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:05.932910 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-378421728", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ca2f64c-caf6-4358-8808-4c0656856257"}], "security_groups": [{"name": "tempest-securitygroup--329448059"}], "key_name": "tempest-keypair-1401257981", "user_data": "}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:06.260064 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:07.927796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.network.neutron [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] validate_networks() for [('3ca2f64c-caf6-4358-8808-4c0656856257', None, None, None, None, None)] {{(pid=132218) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:52:09.003313 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Flavor limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:52:09.004011 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Image limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:52:09.004191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Flavor pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:52:09.004828 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Image pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:52:09.005403 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:52:09.037468 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:09.038025 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:09.044105 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:09.052292 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:09.053808 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:09.057245 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:09.155683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Getting quotas for project 01d9fa7bc7124476aa295e69b120becd. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:52:09.182979 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Getting quotas for user 3aced0ed17b946f9961d87a1d4446c37 and project 01d9fa7bc7124476aa295e69b120becd. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:52:09.242091 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Going to run 1 instances... {{(pid=132217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:52:09.252450 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:52:09.539381 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e7a0b25c-8187-4632-823d-416abe018801 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.060878 Aug 26 08:52:09.542989 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 15/22] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:52:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 4078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 08:52:09.589011 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-186ef701-55f5-4089-b989-a45cbcf9d540 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:09.590075 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-186ef701-55f5-4089-b989-a45cbcf9d540 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:09.655896 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-186ef701-55f5-4089-b989-a45cbcf9d540 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:09.658321 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-186ef701-55f5-4089-b989-a45cbcf9d540 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:09.667243 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-186ef701-55f5-4089-b989-a45cbcf9d540 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:09.676214 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-186ef701-55f5-4089-b989-a45cbcf9d540 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:09.679918 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-186ef701-55f5-4089-b989-a45cbcf9d540 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:09.688615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-186ef701-55f5-4089-b989-a45cbcf9d540 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:10.877239 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-186ef701-55f5-4089-b989-a45cbcf9d540 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:10.953868 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-186ef701-55f5-4089-b989-a45cbcf9d540 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1296 microversion: 2.1 time: 1.382195 Aug 26 08:52:10.958608 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 16/23] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:09 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1296 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:10.995558 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-75f81e94-9235-49e1-996e-df45a3d19771 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:11.001699 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-75f81e94-9235-49e1-996e-df45a3d19771 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:11.026961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-75f81e94-9235-49e1-996e-df45a3d19771 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:11.030035 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-75f81e94-9235-49e1-996e-df45a3d19771 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:11.034353 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-75f81e94-9235-49e1-996e-df45a3d19771 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:11.038034 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-75f81e94-9235-49e1-996e-df45a3d19771 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:11.039983 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-75f81e94-9235-49e1-996e-df45a3d19771 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:11.041821 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-75f81e94-9235-49e1-996e-df45a3d19771 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:12.441955 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-75f81e94-9235-49e1-996e-df45a3d19771 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:12.469204 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-75f81e94-9235-49e1-996e-df45a3d19771 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 1.508460 Aug 26 08:52:12.471559 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 17/24] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:10 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:12.485882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-950d3bfe-66f7-44ae-a30d-a8b55fd983e0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:12.488643 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-950d3bfe-66f7-44ae-a30d-a8b55fd983e0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:12.520859 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-950d3bfe-66f7-44ae-a30d-a8b55fd983e0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:12.521667 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-950d3bfe-66f7-44ae-a30d-a8b55fd983e0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:12.522394 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-950d3bfe-66f7-44ae-a30d-a8b55fd983e0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:12.523402 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-950d3bfe-66f7-44ae-a30d-a8b55fd983e0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:12.524294 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-950d3bfe-66f7-44ae-a30d-a8b55fd983e0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:12.524931 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-950d3bfe-66f7-44ae-a30d-a8b55fd983e0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:12.779411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-950d3bfe-66f7-44ae-a30d-a8b55fd983e0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:12.817792 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-950d3bfe-66f7-44ae-a30d-a8b55fd983e0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1273 microversion: 2.1 time: 0.337290 Aug 26 08:52:12.819326 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 18/25] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:12 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1273 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:12.838551 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Flavor limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:52:12.839576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Image limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:52:12.840503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Flavor pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:52:12.841405 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Image pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:52:12.842488 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:52:12.855373 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-560aef9c-fa4c-41c1-b2e6-a224d25b77f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:12.862566 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-560aef9c-fa4c-41c1-b2e6-a224d25b77f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:12.882024 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-560aef9c-fa4c-41c1-b2e6-a224d25b77f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:12.883711 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:12.884221 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:12.884659 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:12.885249 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-560aef9c-fa4c-41c1-b2e6-a224d25b77f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:12.887414 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-560aef9c-fa4c-41c1-b2e6-a224d25b77f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:12.893471 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:12.894636 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:12.895962 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:12.923739 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-560aef9c-fa4c-41c1-b2e6-a224d25b77f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:12.928169 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-560aef9c-fa4c-41c1-b2e6-a224d25b77f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:12.929657 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-560aef9c-fa4c-41c1-b2e6-a224d25b77f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:12.982188 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Getting quotas for project 8ed7993eba324f94a1b0f7fc23401f0f. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:52:12.998575 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Getting quotas for user 63e1c5a24be04ca4abd5d5109c5763f8 and project 8ed7993eba324f94a1b0f7fc23401f0f. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:52:13.076965 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Going to run 1 instances... {{(pid=132218) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:52:13.085893 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132218) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:52:13.279295 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a86de8ac-91ce-4e7e-9b99-81aa53c93076 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 7.368920 Aug 26 08:52:13.284352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 8/26] 10.222.0.71 () {62 vars in 1188 bytes} [Fri Aug 26 08:52:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 7375 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 26 08:52:13.311886 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-09b5811a-57ea-478b-9686-70c793c89100 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:13.328788 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-09b5811a-57ea-478b-9686-70c793c89100 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:13.459289 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-560aef9c-fa4c-41c1-b2e6-a224d25b77f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:13.494592 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-560aef9c-fa4c-41c1-b2e6-a224d25b77f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1296 microversion: 2.1 time: 0.673695 Aug 26 08:52:13.500946 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 19/27] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:12 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1296 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:13.521936 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9f5bb016-35aa-4d33-bdda-4b5153e35183 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:13.543774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9f5bb016-35aa-4d33-bdda-4b5153e35183 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:13.553560 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9f5bb016-35aa-4d33-bdda-4b5153e35183 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:13.554390 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9f5bb016-35aa-4d33-bdda-4b5153e35183 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:13.555092 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9f5bb016-35aa-4d33-bdda-4b5153e35183 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:13.556316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9f5bb016-35aa-4d33-bdda-4b5153e35183 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:13.580230 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9f5bb016-35aa-4d33-bdda-4b5153e35183 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:13.580917 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9f5bb016-35aa-4d33-bdda-4b5153e35183 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:14.055970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9f5bb016-35aa-4d33-bdda-4b5153e35183 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:14.075500 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9f5bb016-35aa-4d33-bdda-4b5153e35183 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.563223 Aug 26 08:52:14.102903 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 20/28] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:13 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:14.109718 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e5bbc152-4e57-44b3-a085-117d5d8568a3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:14.112177 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e5bbc152-4e57-44b3-a085-117d5d8568a3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:14.128853 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e5bbc152-4e57-44b3-a085-117d5d8568a3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:14.131014 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e5bbc152-4e57-44b3-a085-117d5d8568a3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:14.133001 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e5bbc152-4e57-44b3-a085-117d5d8568a3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:14.134063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e5bbc152-4e57-44b3-a085-117d5d8568a3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:14.138193 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e5bbc152-4e57-44b3-a085-117d5d8568a3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:14.139071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e5bbc152-4e57-44b3-a085-117d5d8568a3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:14.286415 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-09b5811a-57ea-478b-9686-70c793c89100 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:14.317856 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-09b5811a-57ea-478b-9686-70c793c89100 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:14.320018 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-09b5811a-57ea-478b-9686-70c793c89100 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:14.328420 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-09b5811a-57ea-478b-9686-70c793c89100 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1281 microversion: 2.20 time: 1.036455 Aug 26 08:52:14.332341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 9/29] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:13 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1281 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:14.376825 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e5bbc152-4e57-44b3-a085-117d5d8568a3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:14.401424 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e5bbc152-4e57-44b3-a085-117d5d8568a3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1279 microversion: 2.1 time: 0.293184 Aug 26 08:52:14.403169 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 21/30] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:14 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1279 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:14.532005 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8961ca1f-bf6a-42cf-8bde-bc27def2b03b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:14.537222 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8961ca1f-bf6a-42cf-8bde-bc27def2b03b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:14.540500 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=10 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:14.571459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8961ca1f-bf6a-42cf-8bde-bc27def2b03b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:14.577373 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8961ca1f-bf6a-42cf-8bde-bc27def2b03b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:14.579205 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8961ca1f-bf6a-42cf-8bde-bc27def2b03b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:14.580345 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8961ca1f-bf6a-42cf-8bde-bc27def2b03b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:14.584045 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8961ca1f-bf6a-42cf-8bde-bc27def2b03b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:14.587721 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8961ca1f-bf6a-42cf-8bde-bc27def2b03b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:15.106669 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8961ca1f-bf6a-42cf-8bde-bc27def2b03b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:15.112084 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-50577f86-e7e9-4788-9d23-3dac8dc073e0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:15.112943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-50577f86-e7e9-4788-9d23-3dac8dc073e0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:15.120717 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8961ca1f-bf6a-42cf-8bde-bc27def2b03b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1296 microversion: 2.1 time: 0.593296 Aug 26 08:52:15.129799 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 10/31] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:14 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1296 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:15.151638 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-50577f86-e7e9-4788-9d23-3dac8dc073e0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:15.154464 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-50577f86-e7e9-4788-9d23-3dac8dc073e0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:15.156408 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-50577f86-e7e9-4788-9d23-3dac8dc073e0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:15.159677 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-50577f86-e7e9-4788-9d23-3dac8dc073e0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:15.162532 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-50577f86-e7e9-4788-9d23-3dac8dc073e0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:15.163830 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-50577f86-e7e9-4788-9d23-3dac8dc073e0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:15.361597 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f0632a80-0b1a-4d32-bc1b-a78f83ecc3a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:15.362516 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f0632a80-0b1a-4d32-bc1b-a78f83ecc3a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:15.382695 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0632a80-0b1a-4d32-bc1b-a78f83ecc3a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:15.388374 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0632a80-0b1a-4d32-bc1b-a78f83ecc3a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:15.388954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0632a80-0b1a-4d32-bc1b-a78f83ecc3a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:15.389987 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0632a80-0b1a-4d32-bc1b-a78f83ecc3a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:15.390497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0632a80-0b1a-4d32-bc1b-a78f83ecc3a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:15.402310 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0632a80-0b1a-4d32-bc1b-a78f83ecc3a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:15.789789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f0632a80-0b1a-4d32-bc1b-a78f83ecc3a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:15.805380 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f0632a80-0b1a-4d32-bc1b-a78f83ecc3a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:15.810504 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f0632a80-0b1a-4d32-bc1b-a78f83ecc3a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:15.812306 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f0632a80-0b1a-4d32-bc1b-a78f83ecc3a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1277 microversion: 2.20 time: 0.458571 Aug 26 08:52:15.815696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 11/32] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:15 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1277 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:15.824983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b13c6425-8036-4d5b-b377-caa13ecdf8f5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:15.826591 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b13c6425-8036-4d5b-b377-caa13ecdf8f5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:15.833505 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-50577f86-e7e9-4788-9d23-3dac8dc073e0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:15.847930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-50577f86-e7e9-4788-9d23-3dac8dc073e0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.741891 Aug 26 08:52:15.867684 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 22/33] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:15 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:52:15.867979 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b13c6425-8036-4d5b-b377-caa13ecdf8f5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:15.867979 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b13c6425-8036-4d5b-b377-caa13ecdf8f5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:15.867979 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b13c6425-8036-4d5b-b377-caa13ecdf8f5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:15.867979 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b13c6425-8036-4d5b-b377-caa13ecdf8f5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:15.868559 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b13c6425-8036-4d5b-b377-caa13ecdf8f5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:15.876223 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b13c6425-8036-4d5b-b377-caa13ecdf8f5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:16.162828 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-177f6c53-680c-4bef-8284-699a928b787c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:16.169952 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-177f6c53-680c-4bef-8284-699a928b787c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:16.189275 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-177f6c53-680c-4bef-8284-699a928b787c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:16.190455 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-177f6c53-680c-4bef-8284-699a928b787c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:16.192022 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-177f6c53-680c-4bef-8284-699a928b787c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:16.193730 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-177f6c53-680c-4bef-8284-699a928b787c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:16.194873 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-177f6c53-680c-4bef-8284-699a928b787c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:16.195829 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-177f6c53-680c-4bef-8284-699a928b787c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:16.954387 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b13c6425-8036-4d5b-b377-caa13ecdf8f5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:16.973348 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b13c6425-8036-4d5b-b377-caa13ecdf8f5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1279 microversion: 2.1 time: 1.156253 Aug 26 08:52:16.975169 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 12/34] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:15 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1279 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:16.984644 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-24e0a376-fb24-47f2-a31a-9910ee57572c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:16.991358 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-24e0a376-fb24-47f2-a31a-9910ee57572c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:17.016112 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-24e0a376-fb24-47f2-a31a-9910ee57572c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:17.019958 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-24e0a376-fb24-47f2-a31a-9910ee57572c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:17.020786 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-24e0a376-fb24-47f2-a31a-9910ee57572c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:17.021786 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-24e0a376-fb24-47f2-a31a-9910ee57572c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:17.022554 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-24e0a376-fb24-47f2-a31a-9910ee57572c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:17.024696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-24e0a376-fb24-47f2-a31a-9910ee57572c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:17.263974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-24e0a376-fb24-47f2-a31a-9910ee57572c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:17.285565 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-24e0a376-fb24-47f2-a31a-9910ee57572c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:17.293335 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-24e0a376-fb24-47f2-a31a-9910ee57572c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:17.295236 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-24e0a376-fb24-47f2-a31a-9910ee57572c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1333 microversion: 2.20 time: 0.314525 Aug 26 08:52:17.297930 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 13/35] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:16 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1333 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:17.308975 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a72d24e7-8ec9-435b-b828-aae640fa8124 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:17.316438 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a72d24e7-8ec9-435b-b828-aae640fa8124 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:17.343435 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a72d24e7-8ec9-435b-b828-aae640fa8124 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:17.344842 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a72d24e7-8ec9-435b-b828-aae640fa8124 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:17.345559 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a72d24e7-8ec9-435b-b828-aae640fa8124 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:17.347236 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a72d24e7-8ec9-435b-b828-aae640fa8124 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:17.347945 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a72d24e7-8ec9-435b-b828-aae640fa8124 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:17.362299 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a72d24e7-8ec9-435b-b828-aae640fa8124 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:17.730380 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-177f6c53-680c-4bef-8284-699a928b787c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:17.777255 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-177f6c53-680c-4bef-8284-699a928b787c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 1.629065 Aug 26 08:52:17.781661 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 23/36] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:16 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:18.007546 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a72d24e7-8ec9-435b-b828-aae640fa8124 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:18.028177 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fa0a4ed4-591f-473f-a468-3051f0115979 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:18.034128 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-fa0a4ed4-591f-473f-a468-3051f0115979 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:18.062430 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a72d24e7-8ec9-435b-b828-aae640fa8124 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.757776 Aug 26 08:52:18.098777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 14/37] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:17 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:18.099320 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa0a4ed4-591f-473f-a468-3051f0115979 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:18.100666 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa0a4ed4-591f-473f-a468-3051f0115979 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:18.116742 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa0a4ed4-591f-473f-a468-3051f0115979 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:18.119926 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa0a4ed4-591f-473f-a468-3051f0115979 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:18.125456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa0a4ed4-591f-473f-a468-3051f0115979 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:18.128519 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa0a4ed4-591f-473f-a468-3051f0115979 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:18.332906 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f69d1b3d-59dd-410b-b1cc-27fb7a5e52e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:18.333889 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f69d1b3d-59dd-410b-b1cc-27fb7a5e52e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:18.349071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f69d1b3d-59dd-410b-b1cc-27fb7a5e52e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:18.354153 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f69d1b3d-59dd-410b-b1cc-27fb7a5e52e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:18.358522 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f69d1b3d-59dd-410b-b1cc-27fb7a5e52e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:18.359585 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f69d1b3d-59dd-410b-b1cc-27fb7a5e52e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:18.360413 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f69d1b3d-59dd-410b-b1cc-27fb7a5e52e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:18.373887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f69d1b3d-59dd-410b-b1cc-27fb7a5e52e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:18.635912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f69d1b3d-59dd-410b-b1cc-27fb7a5e52e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:18.647855 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-fa0a4ed4-591f-473f-a468-3051f0115979 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:18.656703 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f69d1b3d-59dd-410b-b1cc-27fb7a5e52e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:18.665985 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f69d1b3d-59dd-410b-b1cc-27fb7a5e52e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:18.669278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f69d1b3d-59dd-410b-b1cc-27fb7a5e52e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1339 microversion: 2.20 time: 0.342675 Aug 26 08:52:18.688750 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 15/38] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:18 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1339 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:18.708892 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fa0a4ed4-591f-473f-a468-3051f0115979 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1279 microversion: 2.1 time: 0.707092 Aug 26 08:52:18.728570 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 24/39] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:18 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1279 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:18.820267 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2c44c854-eeb4-4e2a-a2a3-a4aed3c1c3f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:18.822688 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2c44c854-eeb4-4e2a-a2a3-a4aed3c1c3f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:18.858062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2c44c854-eeb4-4e2a-a2a3-a4aed3c1c3f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:18.858906 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2c44c854-eeb4-4e2a-a2a3-a4aed3c1c3f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:18.859727 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2c44c854-eeb4-4e2a-a2a3-a4aed3c1c3f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:18.860643 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2c44c854-eeb4-4e2a-a2a3-a4aed3c1c3f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:18.861250 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2c44c854-eeb4-4e2a-a2a3-a4aed3c1c3f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:18.861813 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2c44c854-eeb4-4e2a-a2a3-a4aed3c1c3f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:19.117231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:19.222179 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=26 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:19.327700 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-b7f04bff-9144-496b-b8fc-fd17b2f17ded req-15fdf2b8-d7c0-460e-9605-4eb0dc64d77a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a8b026c-ef95-4a38-8eca-86005625dd30", "tag": "e25e079a-ddfa-4bd3-849d-dd0e1d98c705"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:19.386455 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-b7f04bff-9144-496b-b8fc-fd17b2f17ded req-15fdf2b8-d7c0-460e-9605-4eb0dc64d77a service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:19.395756 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-b7f04bff-9144-496b-b8fc-fd17b2f17ded req-15fdf2b8-d7c0-460e-9605-4eb0dc64d77a service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:19.396476 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-b7f04bff-9144-496b-b8fc-fd17b2f17ded req-15fdf2b8-d7c0-460e-9605-4eb0dc64d77a service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:19.473110 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-b7f04bff-9144-496b-b8fc-fd17b2f17ded req-15fdf2b8-d7c0-460e-9605-4eb0dc64d77a service nova] Creating event network-changed:e25e079a-ddfa-4bd3-849d-dd0e1d98c705 for instance 1a8b026c-ef95-4a38-8eca-86005625dd30 on hv-cinder-85236 Aug 26 08:52:19.483837 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-b7f04bff-9144-496b-b8fc-fd17b2f17ded req-15fdf2b8-d7c0-460e-9605-4eb0dc64d77a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132218) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 08:52:19.484392 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-b7f04bff-9144-496b-b8fc-fd17b2f17ded req-15fdf2b8-d7c0-460e-9605-4eb0dc64d77a service nova] Acquired lock "compute-rpcapi-router" {{(pid=132218) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 08:52:19.485946 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b92ef143-4f2e-4578-88b5-4ce575716450 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:19.489344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b92ef143-4f2e-4578-88b5-4ce575716450 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:19.499907 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b92ef143-4f2e-4578-88b5-4ce575716450 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:19.502260 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b92ef143-4f2e-4578-88b5-4ce575716450 None None] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:19.509345 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b92ef143-4f2e-4578-88b5-4ce575716450 None None] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:19.511030 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b92ef143-4f2e-4578-88b5-4ce575716450 None None] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:19.576583 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.compute.rpcapi [None req-b92ef143-4f2e-4578-88b5-4ce575716450 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 08:52:19.578337 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b92ef143-4f2e-4578-88b5-4ce575716450 None None] Releasing lock "compute-rpcapi-router" {{(pid=132218) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 08:52:19.648773 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b92ef143-4f2e-4578-88b5-4ce575716450 None None] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.940073 Aug 26 08:52:19.650777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 16/40] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:52:19.678905 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-60353900-e8c9-4581-9702-1e76720f36be tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:19.688791 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-60353900-e8c9-4581-9702-1e76720f36be tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:19.704451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60353900-e8c9-4581-9702-1e76720f36be tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:19.706856 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60353900-e8c9-4581-9702-1e76720f36be tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:19.708985 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60353900-e8c9-4581-9702-1e76720f36be tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:19.711915 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60353900-e8c9-4581-9702-1e76720f36be tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:19.714138 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60353900-e8c9-4581-9702-1e76720f36be tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:19.716667 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60353900-e8c9-4581-9702-1e76720f36be tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:20.665992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2c44c854-eeb4-4e2a-a2a3-a4aed3c1c3f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:20.674520 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=87 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:20.696549 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2c44c854-eeb4-4e2a-a2a3-a4aed3c1c3f0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 1.883533 Aug 26 08:52:20.697357 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 25/41] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:18 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:20.742395 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2b0b3e9f-ffbd-4c97-909f-d1c98de22388 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:20.748829 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2b0b3e9f-ffbd-4c97-909f-d1c98de22388 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:20.752467 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:20.774796 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b0b3e9f-ffbd-4c97-909f-d1c98de22388 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:20.775888 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b0b3e9f-ffbd-4c97-909f-d1c98de22388 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:20.776643 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b0b3e9f-ffbd-4c97-909f-d1c98de22388 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:20.778028 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b0b3e9f-ffbd-4c97-909f-d1c98de22388 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:20.779006 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b0b3e9f-ffbd-4c97-909f-d1c98de22388 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:20.779887 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b0b3e9f-ffbd-4c97-909f-d1c98de22388 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:21.006395 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2b0b3e9f-ffbd-4c97-909f-d1c98de22388 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:21.033540 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2b0b3e9f-ffbd-4c97-909f-d1c98de22388 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:21.042902 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2b0b3e9f-ffbd-4c97-909f-d1c98de22388 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:21.047798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2b0b3e9f-ffbd-4c97-909f-d1c98de22388 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1339 microversion: 2.20 time: 0.330376 Aug 26 08:52:21.051404 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 26/42] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:20 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1339 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:21.069601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6c01a384-ab93-4c74-88cd-49fd251b4482 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:21.074483 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6c01a384-ab93-4c74-88cd-49fd251b4482 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:21.108651 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c01a384-ab93-4c74-88cd-49fd251b4482 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:21.109430 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c01a384-ab93-4c74-88cd-49fd251b4482 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:21.111778 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c01a384-ab93-4c74-88cd-49fd251b4482 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:21.113144 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c01a384-ab93-4c74-88cd-49fd251b4482 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:21.116079 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c01a384-ab93-4c74-88cd-49fd251b4482 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:21.118604 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c01a384-ab93-4c74-88cd-49fd251b4482 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:21.436507 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6c01a384-ab93-4c74-88cd-49fd251b4482 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:21.461821 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6c01a384-ab93-4c74-88cd-49fd251b4482 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1279 microversion: 2.1 time: 0.408687 Aug 26 08:52:21.466321 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 27/43] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:21 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1279 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:21.527807 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-60353900-e8c9-4581-9702-1e76720f36be tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:21.542923 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-60353900-e8c9-4581-9702-1e76720f36be tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 1.889664 Aug 26 08:52:21.544732 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 17/44] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:19 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:21.739817 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ce989df5-29a4-4715-86d0-e311194fa648 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:21.742173 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ce989df5-29a4-4715-86d0-e311194fa648 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:21.763635 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce989df5-29a4-4715-86d0-e311194fa648 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:21.766704 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce989df5-29a4-4715-86d0-e311194fa648 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:21.769167 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce989df5-29a4-4715-86d0-e311194fa648 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:21.773231 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce989df5-29a4-4715-86d0-e311194fa648 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:21.777002 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce989df5-29a4-4715-86d0-e311194fa648 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:21.779477 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce989df5-29a4-4715-86d0-e311194fa648 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:22.124903 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-8dc820c1-f90e-49a3-b821-a4a534ab3a16 req-45491aef-1047-4453-a4f7-c0ff58afc936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b14a44-0641-4121-9855-fe0454700263", "tag": "e6c43102-4bd4-4b6b-8992-a1b7bca6db2b"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:22.174500 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-8dc820c1-f90e-49a3-b821-a4a534ab3a16 req-45491aef-1047-4453-a4f7-c0ff58afc936 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:22.176950 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-8dc820c1-f90e-49a3-b821-a4a534ab3a16 req-45491aef-1047-4453-a4f7-c0ff58afc936 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:22.177810 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-8dc820c1-f90e-49a3-b821-a4a534ab3a16 req-45491aef-1047-4453-a4f7-c0ff58afc936 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:22.247212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-8dc820c1-f90e-49a3-b821-a4a534ab3a16 req-45491aef-1047-4453-a4f7-c0ff58afc936 service nova] Creating event network-changed:e6c43102-4bd4-4b6b-8992-a1b7bca6db2b for instance a0b14a44-0641-4121-9855-fe0454700263 on hv-cinder-85236 Aug 26 08:52:22.248485 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-8dc820c1-f90e-49a3-b821-a4a534ab3a16 req-45491aef-1047-4453-a4f7-c0ff58afc936 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132217) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 08:52:22.249219 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-8dc820c1-f90e-49a3-b821-a4a534ab3a16 req-45491aef-1047-4453-a4f7-c0ff58afc936 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132217) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 08:52:22.259020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e49787cc-f7c4-4609-8576-31c492f53734 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:22.271290 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e49787cc-f7c4-4609-8576-31c492f53734 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:22.272366 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e49787cc-f7c4-4609-8576-31c492f53734 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:22.276442 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e49787cc-f7c4-4609-8576-31c492f53734 None None] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:22.278099 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e49787cc-f7c4-4609-8576-31c492f53734 None None] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:22.280935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e49787cc-f7c4-4609-8576-31c492f53734 None None] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:22.316095 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.compute.rpcapi [None req-e49787cc-f7c4-4609-8576-31c492f53734 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 08:52:22.317406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e49787cc-f7c4-4609-8576-31c492f53734 None None] Releasing lock "compute-rpcapi-router" {{(pid=132217) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 08:52:22.340889 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e49787cc-f7c4-4609-8576-31c492f53734 None None] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.683527 Aug 26 08:52:22.342013 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 28/45] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:52:22.351349 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b648b062-7a09-4a51-bebb-2a53898413ac tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:22.352969 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b648b062-7a09-4a51-bebb-2a53898413ac tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:22.367437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b648b062-7a09-4a51-bebb-2a53898413ac tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:22.368391 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b648b062-7a09-4a51-bebb-2a53898413ac tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:22.369265 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b648b062-7a09-4a51-bebb-2a53898413ac tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:22.370442 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b648b062-7a09-4a51-bebb-2a53898413ac tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:22.371409 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b648b062-7a09-4a51-bebb-2a53898413ac tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:22.372090 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b648b062-7a09-4a51-bebb-2a53898413ac tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:22.694352 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b648b062-7a09-4a51-bebb-2a53898413ac tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:22.706799 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b648b062-7a09-4a51-bebb-2a53898413ac tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:22.711145 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b648b062-7a09-4a51-bebb-2a53898413ac tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:22.712362 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b648b062-7a09-4a51-bebb-2a53898413ac tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1339 microversion: 2.20 time: 0.368622 Aug 26 08:52:22.725431 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ce989df5-29a4-4715-86d0-e311194fa648 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:22.737527 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 29/46] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:22 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1339 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:22.743403 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ce989df5-29a4-4715-86d0-e311194fa648 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 1.005804 Aug 26 08:52:22.749590 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-47aa5fba-eb39-48eb-8463-c4600d9a4e3b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:22.755043 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-47aa5fba-eb39-48eb-8463-c4600d9a4e3b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:22.759496 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 18/47] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:21 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:22.765315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-48581bba-fbee-4ac9-88db-1081506e808b tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:22.768511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47aa5fba-eb39-48eb-8463-c4600d9a4e3b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:22.769014 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47aa5fba-eb39-48eb-8463-c4600d9a4e3b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:22.769454 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47aa5fba-eb39-48eb-8463-c4600d9a4e3b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:22.772507 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47aa5fba-eb39-48eb-8463-c4600d9a4e3b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:22.773444 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47aa5fba-eb39-48eb-8463-c4600d9a4e3b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:22.774102 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-48581bba-fbee-4ac9-88db-1081506e808b tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:22.774285 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47aa5fba-eb39-48eb-8463-c4600d9a4e3b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:22.790853 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-48581bba-fbee-4ac9-88db-1081506e808b tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:22.795767 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-48581bba-fbee-4ac9-88db-1081506e808b tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:22.796628 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-48581bba-fbee-4ac9-88db-1081506e808b tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:22.798065 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-48581bba-fbee-4ac9-88db-1081506e808b tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:22.801093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-48581bba-fbee-4ac9-88db-1081506e808b tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:22.803837 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-48581bba-fbee-4ac9-88db-1081506e808b tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:23.090188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-47aa5fba-eb39-48eb-8463-c4600d9a4e3b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:23.102342 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-47aa5fba-eb39-48eb-8463-c4600d9a4e3b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1321 microversion: 2.1 time: 0.363587 Aug 26 08:52:23.103572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 30/48] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:22 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1321 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:23.198964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-48581bba-fbee-4ac9-88db-1081506e808b tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:23.215872 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-48581bba-fbee-4ac9-88db-1081506e808b tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.454736 Aug 26 08:52:23.231552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 19/49] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:22 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:23.750670 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0e97bec7-360b-452c-9e1d-6bde7cd25ec5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:23.754945 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-0e97bec7-360b-452c-9e1d-6bde7cd25ec5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:23.766691 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2ecd7db5-bfe9-490b-9e4b-fbcf3831ad8e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:23.767560 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2ecd7db5-bfe9-490b-9e4b-fbcf3831ad8e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:23.776917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2ecd7db5-bfe9-490b-9e4b-fbcf3831ad8e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:23.778317 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2ecd7db5-bfe9-490b-9e4b-fbcf3831ad8e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:23.780993 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2ecd7db5-bfe9-490b-9e4b-fbcf3831ad8e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:23.785252 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2ecd7db5-bfe9-490b-9e4b-fbcf3831ad8e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:23.785252 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2ecd7db5-bfe9-490b-9e4b-fbcf3831ad8e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:23.787744 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2ecd7db5-bfe9-490b-9e4b-fbcf3831ad8e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:23.792485 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0e97bec7-360b-452c-9e1d-6bde7cd25ec5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:23.794262 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0e97bec7-360b-452c-9e1d-6bde7cd25ec5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:23.795529 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0e97bec7-360b-452c-9e1d-6bde7cd25ec5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:23.797640 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0e97bec7-360b-452c-9e1d-6bde7cd25ec5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:23.798756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0e97bec7-360b-452c-9e1d-6bde7cd25ec5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:23.800037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0e97bec7-360b-452c-9e1d-6bde7cd25ec5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:24.313954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=20 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:24.345698 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0e97bec7-360b-452c-9e1d-6bde7cd25ec5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:24.408067 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0e97bec7-360b-452c-9e1d-6bde7cd25ec5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:24.414772 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0e97bec7-360b-452c-9e1d-6bde7cd25ec5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:24.417376 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-0e97bec7-360b-452c-9e1d-6bde7cd25ec5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.676373 Aug 26 08:52:24.434018 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 31/50] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:23 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:24.461312 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-902b0921-4a76-4171-9f63-548dbb834f8f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:24.463574 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-902b0921-4a76-4171-9f63-548dbb834f8f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:24.476807 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-902b0921-4a76-4171-9f63-548dbb834f8f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:24.478393 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-902b0921-4a76-4171-9f63-548dbb834f8f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:24.479549 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-902b0921-4a76-4171-9f63-548dbb834f8f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:24.481134 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-902b0921-4a76-4171-9f63-548dbb834f8f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:24.483394 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-902b0921-4a76-4171-9f63-548dbb834f8f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:24.484536 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-902b0921-4a76-4171-9f63-548dbb834f8f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:24.511627 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2ecd7db5-bfe9-490b-9e4b-fbcf3831ad8e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:24.538646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=75 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:24.546439 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2ecd7db5-bfe9-490b-9e4b-fbcf3831ad8e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 0.783517 Aug 26 08:52:24.548161 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 20/51] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:23 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:52:24.555897 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f367847a-3fe3-44f9-a72b-e62f8dab2e33 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:24.557516 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f367847a-3fe3-44f9-a72b-e62f8dab2e33 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:24.569839 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f367847a-3fe3-44f9-a72b-e62f8dab2e33 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:24.570995 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f367847a-3fe3-44f9-a72b-e62f8dab2e33 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:24.571664 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f367847a-3fe3-44f9-a72b-e62f8dab2e33 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:24.574174 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f367847a-3fe3-44f9-a72b-e62f8dab2e33 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:24.575467 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f367847a-3fe3-44f9-a72b-e62f8dab2e33 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:24.580557 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f367847a-3fe3-44f9-a72b-e62f8dab2e33 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:24.999190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-902b0921-4a76-4171-9f63-548dbb834f8f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:25.053642 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-902b0921-4a76-4171-9f63-548dbb834f8f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1321 microversion: 2.1 time: 0.617897 Aug 26 08:52:25.060632 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 32/52] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:24 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1321 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:25.086613 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-265aa751-8f89-4e72-980d-e6be81912401 req-9ce34662-b354-45cb-aacf-d1fde9b149e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18845e10-a764-495f-b6fb-9b0858c695af", "tag": "bacb0225-80ef-4914-92a8-9314236edf1a"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:25.115428 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-265aa751-8f89-4e72-980d-e6be81912401 req-9ce34662-b354-45cb-aacf-d1fde9b149e2 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:25.118221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-265aa751-8f89-4e72-980d-e6be81912401 req-9ce34662-b354-45cb-aacf-d1fde9b149e2 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:25.118830 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-265aa751-8f89-4e72-980d-e6be81912401 req-9ce34662-b354-45cb-aacf-d1fde9b149e2 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:25.152016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-265aa751-8f89-4e72-980d-e6be81912401 req-9ce34662-b354-45cb-aacf-d1fde9b149e2 service nova] Creating event network-changed:bacb0225-80ef-4914-92a8-9314236edf1a for instance 18845e10-a764-495f-b6fb-9b0858c695af on hv-cinder-85236 Aug 26 08:52:25.168078 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-265aa751-8f89-4e72-980d-e6be81912401 req-9ce34662-b354-45cb-aacf-d1fde9b149e2 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104335 Aug 26 08:52:25.171642 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 33/53] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:52:25.474094 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4d6142fc-57bc-46a4-b141-da62065b187d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:25.476888 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4d6142fc-57bc-46a4-b141-da62065b187d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:25.502105 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d6142fc-57bc-46a4-b141-da62065b187d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:25.504655 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d6142fc-57bc-46a4-b141-da62065b187d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:25.507020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d6142fc-57bc-46a4-b141-da62065b187d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:25.507915 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d6142fc-57bc-46a4-b141-da62065b187d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:25.509587 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d6142fc-57bc-46a4-b141-da62065b187d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:25.510824 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d6142fc-57bc-46a4-b141-da62065b187d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:25.859164 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f367847a-3fe3-44f9-a72b-e62f8dab2e33 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:25.891815 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-4d6142fc-57bc-46a4-b141-da62065b187d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:25.894662 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f367847a-3fe3-44f9-a72b-e62f8dab2e33 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 1.344982 Aug 26 08:52:25.901792 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-4d6142fc-57bc-46a4-b141-da62065b187d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:25.903297 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-4d6142fc-57bc-46a4-b141-da62065b187d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:25.904716 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4d6142fc-57bc-46a4-b141-da62065b187d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.439857 Aug 26 08:52:25.905754 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 21/55] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:24 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:25.917479 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9e5e6743-c7df-47d4-9f7e-a76f5a057d07 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:25.918100 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9e5e6743-c7df-47d4-9f7e-a76f5a057d07 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:25.919042 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 34/55] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:25 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:25.925515 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-8fa0587a-cdb7-4835-b14a-6e387f64d7ab req-d5962034-3cae-4c8c-b552-70870799ecb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de0d2d4-3218-426b-a548-91c5891780fa", "tag": "61d58bf1-2d6c-4df7-8638-a30df721d2e9"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:25.937317 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9e5e6743-c7df-47d4-9f7e-a76f5a057d07 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:25.937894 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9e5e6743-c7df-47d4-9f7e-a76f5a057d07 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:25.938449 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9e5e6743-c7df-47d4-9f7e-a76f5a057d07 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:25.939125 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-8fa0587a-cdb7-4835-b14a-6e387f64d7ab req-d5962034-3cae-4c8c-b552-70870799ecb5 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:25.939414 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9e5e6743-c7df-47d4-9f7e-a76f5a057d07 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:25.939884 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9e5e6743-c7df-47d4-9f7e-a76f5a057d07 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:25.940200 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-8fa0587a-cdb7-4835-b14a-6e387f64d7ab req-d5962034-3cae-4c8c-b552-70870799ecb5 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:25.940400 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9e5e6743-c7df-47d4-9f7e-a76f5a057d07 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:25.940932 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-8fa0587a-cdb7-4835-b14a-6e387f64d7ab req-d5962034-3cae-4c8c-b552-70870799ecb5 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:25.960666 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-8fa0587a-cdb7-4835-b14a-6e387f64d7ab req-d5962034-3cae-4c8c-b552-70870799ecb5 service nova] Creating event network-changed:61d58bf1-2d6c-4df7-8638-a30df721d2e9 for instance 8de0d2d4-3218-426b-a548-91c5891780fa on hv-cinder-85236 Aug 26 08:52:25.973450 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-8fa0587a-cdb7-4835-b14a-6e387f64d7ab req-d5962034-3cae-4c8c-b552-70870799ecb5 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053012 Aug 26 08:52:25.980553 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 35/56] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:52:26.093509 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-348181a7-7ab8-4056-a814-5074dceaccd3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:26.095348 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-348181a7-7ab8-4056-a814-5074dceaccd3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:26.108171 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-348181a7-7ab8-4056-a814-5074dceaccd3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:26.112296 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-348181a7-7ab8-4056-a814-5074dceaccd3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:26.114471 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-348181a7-7ab8-4056-a814-5074dceaccd3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:26.132102 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-348181a7-7ab8-4056-a814-5074dceaccd3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:26.134114 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-348181a7-7ab8-4056-a814-5074dceaccd3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:26.138068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-348181a7-7ab8-4056-a814-5074dceaccd3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:26.372759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9e5e6743-c7df-47d4-9f7e-a76f5a057d07 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:26.392690 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9e5e6743-c7df-47d4-9f7e-a76f5a057d07 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 0.485507 Aug 26 08:52:26.398586 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 22/57] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:25 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:26.486631 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-348181a7-7ab8-4056-a814-5074dceaccd3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:26.502562 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-348181a7-7ab8-4056-a814-5074dceaccd3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1321 microversion: 2.1 time: 0.416681 Aug 26 08:52:26.504160 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 36/58] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:26 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:26.923867 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d949de7f-0af8-4a32-bd08-42e4efcccf4f tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:26.925122 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d949de7f-0af8-4a32-bd08-42e4efcccf4f tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:26.937187 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a158263c-bd99-4d3a-bc01-9ea00e484591 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:26.937843 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a158263c-bd99-4d3a-bc01-9ea00e484591 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:26.942476 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d949de7f-0af8-4a32-bd08-42e4efcccf4f tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:26.955536 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d949de7f-0af8-4a32-bd08-42e4efcccf4f tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:26.956103 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d949de7f-0af8-4a32-bd08-42e4efcccf4f tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:26.957345 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d949de7f-0af8-4a32-bd08-42e4efcccf4f tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:26.960329 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d949de7f-0af8-4a32-bd08-42e4efcccf4f tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:26.962979 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d949de7f-0af8-4a32-bd08-42e4efcccf4f tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:26.964937 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a158263c-bd99-4d3a-bc01-9ea00e484591 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:26.965801 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a158263c-bd99-4d3a-bc01-9ea00e484591 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:26.970167 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a158263c-bd99-4d3a-bc01-9ea00e484591 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:26.977206 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a158263c-bd99-4d3a-bc01-9ea00e484591 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:26.978354 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a158263c-bd99-4d3a-bc01-9ea00e484591 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:26.980999 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a158263c-bd99-4d3a-bc01-9ea00e484591 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:27.666115 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d949de7f-0af8-4a32-bd08-42e4efcccf4f tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:27.681343 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d949de7f-0af8-4a32-bd08-42e4efcccf4f tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.762725 Aug 26 08:52:27.682224 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 23/59] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:26 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:27.710129 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-b323ea77-38e6-47f9-a36d-acf399ffdb23 req-3218613c-bd66-4cb2-8d0d-6f8a8bc05347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14ea47a3-6a48-4509-8799-634e4e77319c", "tag": "f2f9abb5-5c56-40e3-aed3-5d7eb434f36c"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:27.728978 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-b323ea77-38e6-47f9-a36d-acf399ffdb23 req-3218613c-bd66-4cb2-8d0d-6f8a8bc05347 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:27.736834 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-b323ea77-38e6-47f9-a36d-acf399ffdb23 req-3218613c-bd66-4cb2-8d0d-6f8a8bc05347 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:27.737433 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-b323ea77-38e6-47f9-a36d-acf399ffdb23 req-3218613c-bd66-4cb2-8d0d-6f8a8bc05347 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:27.767257 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-b323ea77-38e6-47f9-a36d-acf399ffdb23 req-3218613c-bd66-4cb2-8d0d-6f8a8bc05347 service nova] Creating event network-changed:f2f9abb5-5c56-40e3-aed3-5d7eb434f36c for instance 14ea47a3-6a48-4509-8799-634e4e77319c on hv-cinder-85236 Aug 26 08:52:27.773412 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-b323ea77-38e6-47f9-a36d-acf399ffdb23 req-3218613c-bd66-4cb2-8d0d-6f8a8bc05347 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076696 Aug 26 08:52:27.774848 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 24/60] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:52:27.780689 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4ead44bf-890c-40d9-8658-19a63d1684cb tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:27.786458 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4ead44bf-890c-40d9-8658-19a63d1684cb tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:27.803492 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ead44bf-890c-40d9-8658-19a63d1684cb tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:27.804272 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ead44bf-890c-40d9-8658-19a63d1684cb tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:27.804864 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ead44bf-890c-40d9-8658-19a63d1684cb tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:27.808017 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ead44bf-890c-40d9-8658-19a63d1684cb tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:27.808685 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ead44bf-890c-40d9-8658-19a63d1684cb tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:27.809257 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ead44bf-890c-40d9-8658-19a63d1684cb tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:28.064028 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a158263c-bd99-4d3a-bc01-9ea00e484591 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:28.090603 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a158263c-bd99-4d3a-bc01-9ea00e484591 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:28.099276 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a158263c-bd99-4d3a-bc01-9ea00e484591 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:28.104281 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a158263c-bd99-4d3a-bc01-9ea00e484591 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 1.175200 Aug 26 08:52:28.109019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 37/61] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:26 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:52:28.114505 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-7c5644e6-b821-4dda-9604-696c041e91ca tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:28.115265 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-7c5644e6-b821-4dda-9604-696c041e91ca tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:28.129969 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7c5644e6-b821-4dda-9604-696c041e91ca tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:28.131124 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7c5644e6-b821-4dda-9604-696c041e91ca tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:28.135413 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7c5644e6-b821-4dda-9604-696c041e91ca tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:28.139194 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7c5644e6-b821-4dda-9604-696c041e91ca tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:28.140145 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7c5644e6-b821-4dda-9604-696c041e91ca tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:28.140803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7c5644e6-b821-4dda-9604-696c041e91ca tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:28.275706 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4ead44bf-890c-40d9-8658-19a63d1684cb tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:28.289163 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4ead44bf-890c-40d9-8658-19a63d1684cb tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 0.512832 Aug 26 08:52:28.305145 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 25/62] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:27 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:28.779242 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-53426c3b-6c90-4aaa-9b03-433f4bd5674f req-89bb0006-a6f3-4c49-9592-73f024e7cadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a8b026c-ef95-4a38-8eca-86005625dd30", "name": "network-vif-plugged", "status": "completed", "tag": "e25e079a-ddfa-4bd3-849d-dd0e1d98c705"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:28.808402 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-53426c3b-6c90-4aaa-9b03-433f4bd5674f req-89bb0006-a6f3-4c49-9592-73f024e7cadd service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:28.809019 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-53426c3b-6c90-4aaa-9b03-433f4bd5674f req-89bb0006-a6f3-4c49-9592-73f024e7cadd service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:28.810180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-53426c3b-6c90-4aaa-9b03-433f4bd5674f req-89bb0006-a6f3-4c49-9592-73f024e7cadd service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:28.841528 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-53426c3b-6c90-4aaa-9b03-433f4bd5674f req-89bb0006-a6f3-4c49-9592-73f024e7cadd service nova] Creating event network-vif-plugged:e25e079a-ddfa-4bd3-849d-dd0e1d98c705 for instance 1a8b026c-ef95-4a38-8eca-86005625dd30 on hv-cinder-85236 Aug 26 08:52:28.858642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-53426c3b-6c90-4aaa-9b03-433f4bd5674f req-89bb0006-a6f3-4c49-9592-73f024e7cadd service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.549366 Aug 26 08:52:28.861020 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 26/63] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:52:28.885709 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3cdc3955-6ef2-43d4-b19c-24608ce4ba71 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:28.891169 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3cdc3955-6ef2-43d4-b19c-24608ce4ba71 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:28.912478 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cdc3955-6ef2-43d4-b19c-24608ce4ba71 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:28.917682 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cdc3955-6ef2-43d4-b19c-24608ce4ba71 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:28.918661 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cdc3955-6ef2-43d4-b19c-24608ce4ba71 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:28.923767 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7c5644e6-b821-4dda-9604-696c041e91ca tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:28.934412 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cdc3955-6ef2-43d4-b19c-24608ce4ba71 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:28.936704 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cdc3955-6ef2-43d4-b19c-24608ce4ba71 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:28.941742 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cdc3955-6ef2-43d4-b19c-24608ce4ba71 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:28.957494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-7c5644e6-b821-4dda-9604-696c041e91ca tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1321 microversion: 2.1 time: 0.842402 Aug 26 08:52:28.995207 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 38/64] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:28 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1321 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:29.137943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2b4a8d15-e620-44a6-bdab-5865dc77cbcf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:29.138549 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2b4a8d15-e620-44a6-bdab-5865dc77cbcf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:29.151252 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b4a8d15-e620-44a6-bdab-5865dc77cbcf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:29.151763 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b4a8d15-e620-44a6-bdab-5865dc77cbcf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:29.155011 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b4a8d15-e620-44a6-bdab-5865dc77cbcf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:29.156621 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b4a8d15-e620-44a6-bdab-5865dc77cbcf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:29.157448 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b4a8d15-e620-44a6-bdab-5865dc77cbcf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:29.159194 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b4a8d15-e620-44a6-bdab-5865dc77cbcf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:29.304642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3cdc3955-6ef2-43d4-b19c-24608ce4ba71 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:29.323910 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3cdc3955-6ef2-43d4-b19c-24608ce4ba71 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.452093 Aug 26 08:52:29.324858 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 27/65] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:28 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:29.341549 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9b6adf4f-0338-417b-abe7-0ef1d839012a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:29.343642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9b6adf4f-0338-417b-abe7-0ef1d839012a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:29.366453 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6adf4f-0338-417b-abe7-0ef1d839012a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:29.367568 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6adf4f-0338-417b-abe7-0ef1d839012a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:29.368019 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6adf4f-0338-417b-abe7-0ef1d839012a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:29.368786 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6adf4f-0338-417b-abe7-0ef1d839012a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:29.378165 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6adf4f-0338-417b-abe7-0ef1d839012a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:29.378991 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6adf4f-0338-417b-abe7-0ef1d839012a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:29.499830 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2b4a8d15-e620-44a6-bdab-5865dc77cbcf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:29.521357 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2b4a8d15-e620-44a6-bdab-5865dc77cbcf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:29.521357 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2b4a8d15-e620-44a6-bdab-5865dc77cbcf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:29.521357 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2b4a8d15-e620-44a6-bdab-5865dc77cbcf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.382952 Aug 26 08:52:29.523632 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 39/66] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:29 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:29.543255 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=8 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:29.691790 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9b6adf4f-0338-417b-abe7-0ef1d839012a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:29.701895 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9b6adf4f-0338-417b-abe7-0ef1d839012a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 0.375058 Aug 26 08:52:29.712961 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 28/67] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:29 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:29.988308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ca8bc6a9-5fc5-49b6-a32c-484aea4f7dbc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:29.988939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ca8bc6a9-5fc5-49b6-a32c-484aea4f7dbc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:30.002668 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca8bc6a9-5fc5-49b6-a32c-484aea4f7dbc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:30.003338 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca8bc6a9-5fc5-49b6-a32c-484aea4f7dbc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:30.004057 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca8bc6a9-5fc5-49b6-a32c-484aea4f7dbc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:30.004987 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca8bc6a9-5fc5-49b6-a32c-484aea4f7dbc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:30.005501 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca8bc6a9-5fc5-49b6-a32c-484aea4f7dbc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:30.006147 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca8bc6a9-5fc5-49b6-a32c-484aea4f7dbc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:30.207673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ca8bc6a9-5fc5-49b6-a32c-484aea4f7dbc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:30.221388 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ca8bc6a9-5fc5-49b6-a32c-484aea4f7dbc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1321 microversion: 2.1 time: 0.239046 Aug 26 08:52:30.225237 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 40/68] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:29 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:52:30.346305 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1c8ad3ca-b6d3-4d93-b881-49ed6916f2b8 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:30.347364 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1c8ad3ca-b6d3-4d93-b881-49ed6916f2b8 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:30.356549 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1c8ad3ca-b6d3-4d93-b881-49ed6916f2b8 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:30.357429 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1c8ad3ca-b6d3-4d93-b881-49ed6916f2b8 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:30.358050 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1c8ad3ca-b6d3-4d93-b881-49ed6916f2b8 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:30.358944 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1c8ad3ca-b6d3-4d93-b881-49ed6916f2b8 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:30.364392 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1c8ad3ca-b6d3-4d93-b881-49ed6916f2b8 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:30.364933 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1c8ad3ca-b6d3-4d93-b881-49ed6916f2b8 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:30.550979 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9ee3986e-cbc0-493c-885e-2327de0b6729 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:30.552089 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9ee3986e-cbc0-493c-885e-2327de0b6729 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:30.566972 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1c8ad3ca-b6d3-4d93-b881-49ed6916f2b8 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:30.577244 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9ee3986e-cbc0-493c-885e-2327de0b6729 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:30.582138 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9ee3986e-cbc0-493c-885e-2327de0b6729 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:30.582995 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9ee3986e-cbc0-493c-885e-2327de0b6729 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:30.586437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9ee3986e-cbc0-493c-885e-2327de0b6729 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:30.587366 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9ee3986e-cbc0-493c-885e-2327de0b6729 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:30.587498 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1c8ad3ca-b6d3-4d93-b881-49ed6916f2b8 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.244237 Aug 26 08:52:30.588625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 29/69] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:30 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:52:30.589250 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9ee3986e-cbc0-493c-885e-2327de0b6729 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:30.725601 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-fb10f426-08c5-45d6-aef0-4846cb1e8a1a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:30.726473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-fb10f426-08c5-45d6-aef0-4846cb1e8a1a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:30.734599 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fb10f426-08c5-45d6-aef0-4846cb1e8a1a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:30.735724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fb10f426-08c5-45d6-aef0-4846cb1e8a1a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:30.736742 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fb10f426-08c5-45d6-aef0-4846cb1e8a1a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:30.737763 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fb10f426-08c5-45d6-aef0-4846cb1e8a1a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:30.738561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fb10f426-08c5-45d6-aef0-4846cb1e8a1a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:30.739900 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fb10f426-08c5-45d6-aef0-4846cb1e8a1a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:30.898339 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9ee3986e-cbc0-493c-885e-2327de0b6729 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:30.911556 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9ee3986e-cbc0-493c-885e-2327de0b6729 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:30.915180 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9ee3986e-cbc0-493c-885e-2327de0b6729 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:30.916461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9ee3986e-cbc0-493c-885e-2327de0b6729 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.373992 Aug 26 08:52:30.923558 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 41/70] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:30 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:52:31.068753 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-fb10f426-08c5-45d6-aef0-4846cb1e8a1a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:31.081393 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-fb10f426-08c5-45d6-aef0-4846cb1e8a1a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 0.360434 Aug 26 08:52:31.082685 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 30/71] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:30 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:31.260816 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-5da9b259-60e4-4ad2-bb67-4f354773a7fc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:31.262365 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-5da9b259-60e4-4ad2-bb67-4f354773a7fc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:31.271534 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5da9b259-60e4-4ad2-bb67-4f354773a7fc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:31.273170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5da9b259-60e4-4ad2-bb67-4f354773a7fc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:31.273849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5da9b259-60e4-4ad2-bb67-4f354773a7fc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:31.275690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5da9b259-60e4-4ad2-bb67-4f354773a7fc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:31.277091 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5da9b259-60e4-4ad2-bb67-4f354773a7fc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:31.277621 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5da9b259-60e4-4ad2-bb67-4f354773a7fc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:31.480005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-5da9b259-60e4-4ad2-bb67-4f354773a7fc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:31.507246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-5da9b259-60e4-4ad2-bb67-4f354773a7fc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1321 microversion: 2.1 time: 0.250459 Aug 26 08:52:31.523875 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 42/72] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:31 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:52:31.628579 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4557055c-39a2-47d4-bce8-2831da4a0cef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:31.629500 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4557055c-39a2-47d4-bce8-2831da4a0cef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:31.644984 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4557055c-39a2-47d4-bce8-2831da4a0cef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:31.645826 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4557055c-39a2-47d4-bce8-2831da4a0cef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:31.646523 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4557055c-39a2-47d4-bce8-2831da4a0cef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:31.647800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4557055c-39a2-47d4-bce8-2831da4a0cef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:31.648926 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4557055c-39a2-47d4-bce8-2831da4a0cef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:31.649878 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4557055c-39a2-47d4-bce8-2831da4a0cef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:31.944772 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-00111158-171a-4f44-a3c1-b8ff0c22a004 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:31.945395 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-00111158-171a-4f44-a3c1-b8ff0c22a004 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:31.955774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00111158-171a-4f44-a3c1-b8ff0c22a004 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:31.956619 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00111158-171a-4f44-a3c1-b8ff0c22a004 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:31.957237 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00111158-171a-4f44-a3c1-b8ff0c22a004 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:31.959410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00111158-171a-4f44-a3c1-b8ff0c22a004 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:31.960439 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00111158-171a-4f44-a3c1-b8ff0c22a004 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:31.961046 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00111158-171a-4f44-a3c1-b8ff0c22a004 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:32.016641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4557055c-39a2-47d4-bce8-2831da4a0cef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:32.029691 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4557055c-39a2-47d4-bce8-2831da4a0cef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.407883 Aug 26 08:52:32.047339 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 31/73] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:31 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:32.109820 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-32771687-45ea-40ac-a6e1-7100e0238813 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:32.112148 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-32771687-45ea-40ac-a6e1-7100e0238813 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:32.124218 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-32771687-45ea-40ac-a6e1-7100e0238813 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:32.125644 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-32771687-45ea-40ac-a6e1-7100e0238813 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:32.126589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-32771687-45ea-40ac-a6e1-7100e0238813 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:32.127698 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-32771687-45ea-40ac-a6e1-7100e0238813 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:32.128637 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-32771687-45ea-40ac-a6e1-7100e0238813 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:32.129498 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-32771687-45ea-40ac-a6e1-7100e0238813 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:32.301773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-00111158-171a-4f44-a3c1-b8ff0c22a004 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:32.311511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:32.320730 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-00111158-171a-4f44-a3c1-b8ff0c22a004 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:32.324398 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-00111158-171a-4f44-a3c1-b8ff0c22a004 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:32.327851 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-00111158-171a-4f44-a3c1-b8ff0c22a004 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.386575 Aug 26 08:52:32.329830 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 43/74] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:31 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:52:32.492676 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-32771687-45ea-40ac-a6e1-7100e0238813 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:32.508247 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-32771687-45ea-40ac-a6e1-7100e0238813 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 0.406860 Aug 26 08:52:32.515704 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 32/75] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:32 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:32.537842 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-12ebd706-f8a2-4c3d-8ee7-05bd35bf513b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:32.538467 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-12ebd706-f8a2-4c3d-8ee7-05bd35bf513b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:32.549368 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-12ebd706-f8a2-4c3d-8ee7-05bd35bf513b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:32.550366 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-12ebd706-f8a2-4c3d-8ee7-05bd35bf513b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:32.550810 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-12ebd706-f8a2-4c3d-8ee7-05bd35bf513b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:32.551864 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-12ebd706-f8a2-4c3d-8ee7-05bd35bf513b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:32.552547 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-12ebd706-f8a2-4c3d-8ee7-05bd35bf513b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:32.553300 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-12ebd706-f8a2-4c3d-8ee7-05bd35bf513b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:32.558767 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=100 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:32.886358 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-12ebd706-f8a2-4c3d-8ee7-05bd35bf513b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:32.902598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-12ebd706-f8a2-4c3d-8ee7-05bd35bf513b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1321 microversion: 2.1 time: 0.368596 Aug 26 08:52:32.904534 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 44/76] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:32 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:33.055155 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-704d3664-2797-48b0-8ff8-566f9476f3fe tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:33.056027 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-704d3664-2797-48b0-8ff8-566f9476f3fe tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:33.068097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-704d3664-2797-48b0-8ff8-566f9476f3fe tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:33.069270 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-704d3664-2797-48b0-8ff8-566f9476f3fe tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:33.070142 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-704d3664-2797-48b0-8ff8-566f9476f3fe tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:33.071297 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-704d3664-2797-48b0-8ff8-566f9476f3fe tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:33.072090 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-704d3664-2797-48b0-8ff8-566f9476f3fe tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:33.072762 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-704d3664-2797-48b0-8ff8-566f9476f3fe tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:33.371646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-dd2f9a05-0673-4236-8fa2-1e41196c0ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:33.379481 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-dd2f9a05-0673-4236-8fa2-1e41196c0ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:33.396881 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd2f9a05-0673-4236-8fa2-1e41196c0ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:33.398573 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd2f9a05-0673-4236-8fa2-1e41196c0ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:33.399714 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd2f9a05-0673-4236-8fa2-1e41196c0ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:33.400614 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd2f9a05-0673-4236-8fa2-1e41196c0ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:33.409862 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd2f9a05-0673-4236-8fa2-1e41196c0ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:33.410499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd2f9a05-0673-4236-8fa2-1e41196c0ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:33.796630 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-704d3664-2797-48b0-8ff8-566f9476f3fe tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:33.832144 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-dd2f9a05-0673-4236-8fa2-1e41196c0ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:33.845982 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-dd2f9a05-0673-4236-8fa2-1e41196c0ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:33.858361 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-dd2f9a05-0673-4236-8fa2-1e41196c0ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:33.867925 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-704d3664-2797-48b0-8ff8-566f9476f3fe tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.792854 Aug 26 08:52:33.867925 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 33/77] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:33 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:33.872444 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5059edbb-5135-4775-9a4d-2090ee0d701c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:33.879943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-dd2f9a05-0673-4236-8fa2-1e41196c0ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.501947 Aug 26 08:52:33.884327 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 45/78] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:33 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:33.888247 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5059edbb-5135-4775-9a4d-2090ee0d701c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:33.928036 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-eb568bca-bf85-406c-adc5-43eaa4e886e4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:33.929565 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-eb568bca-bf85-406c-adc5-43eaa4e886e4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:33.942312 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5059edbb-5135-4775-9a4d-2090ee0d701c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:33.947798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eb568bca-bf85-406c-adc5-43eaa4e886e4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:33.950432 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eb568bca-bf85-406c-adc5-43eaa4e886e4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:33.951353 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5059edbb-5135-4775-9a4d-2090ee0d701c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:33.955928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eb568bca-bf85-406c-adc5-43eaa4e886e4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:33.957047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eb568bca-bf85-406c-adc5-43eaa4e886e4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:33.957911 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5059edbb-5135-4775-9a4d-2090ee0d701c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:33.959632 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5059edbb-5135-4775-9a4d-2090ee0d701c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:33.962692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eb568bca-bf85-406c-adc5-43eaa4e886e4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:33.964807 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5059edbb-5135-4775-9a4d-2090ee0d701c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:33.966591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eb568bca-bf85-406c-adc5-43eaa4e886e4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:33.972316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5059edbb-5135-4775-9a4d-2090ee0d701c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:34.405167 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-eb568bca-bf85-406c-adc5-43eaa4e886e4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:34.419743 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-eb568bca-bf85-406c-adc5-43eaa4e886e4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1321 microversion: 2.1 time: 0.495585 Aug 26 08:52:34.420448 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 46/79] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:33 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1321 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:34.580662 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5059edbb-5135-4775-9a4d-2090ee0d701c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:34.596727 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5059edbb-5135-4775-9a4d-2090ee0d701c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 0.730664 Aug 26 08:52:34.597036 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 34/80] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:33 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:34.917500 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-69f036ee-3795-4c21-b84b-481534f5b218 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:34.919317 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e140777e-9286-45d6-ac51-d0406eaf9824 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:34.919539 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-69f036ee-3795-4c21-b84b-481534f5b218 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:34.921708 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e140777e-9286-45d6-ac51-d0406eaf9824 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:34.937803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69f036ee-3795-4c21-b84b-481534f5b218 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:34.938988 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69f036ee-3795-4c21-b84b-481534f5b218 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:34.939585 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69f036ee-3795-4c21-b84b-481534f5b218 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:34.940960 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69f036ee-3795-4c21-b84b-481534f5b218 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:34.941678 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69f036ee-3795-4c21-b84b-481534f5b218 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:34.942540 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69f036ee-3795-4c21-b84b-481534f5b218 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:34.964779 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e140777e-9286-45d6-ac51-d0406eaf9824 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:34.965734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e140777e-9286-45d6-ac51-d0406eaf9824 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:34.966487 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e140777e-9286-45d6-ac51-d0406eaf9824 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:34.967400 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e140777e-9286-45d6-ac51-d0406eaf9824 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:34.968224 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e140777e-9286-45d6-ac51-d0406eaf9824 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:34.968895 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e140777e-9286-45d6-ac51-d0406eaf9824 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:35.268069 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-69f036ee-3795-4c21-b84b-481534f5b218 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:35.284306 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-69f036ee-3795-4c21-b84b-481534f5b218 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.385819 Aug 26 08:52:35.285410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 47/81] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:34 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:35.330475 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e140777e-9286-45d6-ac51-d0406eaf9824 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:35.346279 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e140777e-9286-45d6-ac51-d0406eaf9824 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:35.348451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e140777e-9286-45d6-ac51-d0406eaf9824 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:35.349619 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e140777e-9286-45d6-ac51-d0406eaf9824 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.445693 Aug 26 08:52:35.350198 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 35/82] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:34 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:35.446584 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ddb6c6d9-d1c2-4f9e-93a1-a02e1cb74ab3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:35.448394 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ddb6c6d9-d1c2-4f9e-93a1-a02e1cb74ab3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:35.462507 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ddb6c6d9-d1c2-4f9e-93a1-a02e1cb74ab3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:35.463459 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ddb6c6d9-d1c2-4f9e-93a1-a02e1cb74ab3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:35.464327 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ddb6c6d9-d1c2-4f9e-93a1-a02e1cb74ab3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:35.465758 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ddb6c6d9-d1c2-4f9e-93a1-a02e1cb74ab3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:35.466613 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ddb6c6d9-d1c2-4f9e-93a1-a02e1cb74ab3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:35.467593 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ddb6c6d9-d1c2-4f9e-93a1-a02e1cb74ab3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:35.626354 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7d96e9c8-3fac-4e4b-bb89-5a3b7da66936 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:35.630504 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-7d96e9c8-3fac-4e4b-bb89-5a3b7da66936 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:35.647661 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7d96e9c8-3fac-4e4b-bb89-5a3b7da66936 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:35.648997 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7d96e9c8-3fac-4e4b-bb89-5a3b7da66936 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:35.650051 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7d96e9c8-3fac-4e4b-bb89-5a3b7da66936 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:35.653796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7d96e9c8-3fac-4e4b-bb89-5a3b7da66936 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:35.654954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7d96e9c8-3fac-4e4b-bb89-5a3b7da66936 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:35.655898 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7d96e9c8-3fac-4e4b-bb89-5a3b7da66936 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:35.698608 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ddb6c6d9-d1c2-4f9e-93a1-a02e1cb74ab3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:35.712901 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ddb6c6d9-d1c2-4f9e-93a1-a02e1cb74ab3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1321 microversion: 2.1 time: 0.272793 Aug 26 08:52:35.714126 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 48/83] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:35 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:36.089839 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-4a1615e4-e5b2-467f-9b75-2e6bb77420c3 req-e5e5dac6-d492-460d-bece-2e8e1762de28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18845e10-a764-495f-b6fb-9b0858c695af", "name": "network-vif-plugged", "status": "completed", "tag": "bacb0225-80ef-4914-92a8-9314236edf1a"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:36.110098 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-7d96e9c8-3fac-4e4b-bb89-5a3b7da66936 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:36.119080 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-4a1615e4-e5b2-467f-9b75-2e6bb77420c3 req-e5e5dac6-d492-460d-bece-2e8e1762de28 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:36.119771 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-4a1615e4-e5b2-467f-9b75-2e6bb77420c3 req-e5e5dac6-d492-460d-bece-2e8e1762de28 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:36.120199 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-4a1615e4-e5b2-467f-9b75-2e6bb77420c3 req-e5e5dac6-d492-460d-bece-2e8e1762de28 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:36.139337 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-4a1615e4-e5b2-467f-9b75-2e6bb77420c3 req-e5e5dac6-d492-460d-bece-2e8e1762de28 service nova] Creating event network-vif-plugged:bacb0225-80ef-4914-92a8-9314236edf1a for instance 18845e10-a764-495f-b6fb-9b0858c695af on hv-cinder-85236 Aug 26 08:52:36.139602 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7d96e9c8-3fac-4e4b-bb89-5a3b7da66936 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 0.517245 Aug 26 08:52:36.158229 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-4a1615e4-e5b2-467f-9b75-2e6bb77420c3 req-e5e5dac6-d492-460d-bece-2e8e1762de28 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074445 Aug 26 08:52:36.159805 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 49/84] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:52:36.163587 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 36/85] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:35 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:52:36.325424 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1c6c750d-7ab4-4b24-9d6b-c7cb190d7235 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:36.327755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1c6c750d-7ab4-4b24-9d6b-c7cb190d7235 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:36.371492 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1c6c750d-7ab4-4b24-9d6b-c7cb190d7235 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:36.380424 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a87dc029-8d5e-4b2f-bfb7-0cc2ccef9846 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:36.382615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1c6c750d-7ab4-4b24-9d6b-c7cb190d7235 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:36.383291 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1c6c750d-7ab4-4b24-9d6b-c7cb190d7235 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:36.389730 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a87dc029-8d5e-4b2f-bfb7-0cc2ccef9846 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:36.390649 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1c6c750d-7ab4-4b24-9d6b-c7cb190d7235 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:36.391399 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1c6c750d-7ab4-4b24-9d6b-c7cb190d7235 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:36.392173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1c6c750d-7ab4-4b24-9d6b-c7cb190d7235 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:36.420230 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a87dc029-8d5e-4b2f-bfb7-0cc2ccef9846 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:36.421563 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a87dc029-8d5e-4b2f-bfb7-0cc2ccef9846 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:36.425395 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a87dc029-8d5e-4b2f-bfb7-0cc2ccef9846 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:36.426796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a87dc029-8d5e-4b2f-bfb7-0cc2ccef9846 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:36.438707 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a87dc029-8d5e-4b2f-bfb7-0cc2ccef9846 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:36.439548 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a87dc029-8d5e-4b2f-bfb7-0cc2ccef9846 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:36.789378 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1c6c750d-7ab4-4b24-9d6b-c7cb190d7235 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:36.806463 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1c6c750d-7ab4-4b24-9d6b-c7cb190d7235 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.493085 Aug 26 08:52:36.821007 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 50/86] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:36 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:36.832831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-26598b0b-8e77-44a8-909e-bf20513d9f9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:36.833459 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-26598b0b-8e77-44a8-909e-bf20513d9f9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:36.873816 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-26598b0b-8e77-44a8-909e-bf20513d9f9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:36.874318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-26598b0b-8e77-44a8-909e-bf20513d9f9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:36.874760 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-26598b0b-8e77-44a8-909e-bf20513d9f9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:36.876497 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-26598b0b-8e77-44a8-909e-bf20513d9f9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:36.877143 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-26598b0b-8e77-44a8-909e-bf20513d9f9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:36.877590 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-26598b0b-8e77-44a8-909e-bf20513d9f9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:36.905792 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a87dc029-8d5e-4b2f-bfb7-0cc2ccef9846 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:36.915885 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a87dc029-8d5e-4b2f-bfb7-0cc2ccef9846 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:36.917476 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a87dc029-8d5e-4b2f-bfb7-0cc2ccef9846 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:36.918775 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a87dc029-8d5e-4b2f-bfb7-0cc2ccef9846 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.549288 Aug 26 08:52:36.919612 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 37/87] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:36 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:37.069673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-26598b0b-8e77-44a8-909e-bf20513d9f9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:37.080555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-26598b0b-8e77-44a8-909e-bf20513d9f9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1321 microversion: 2.1 time: 0.254974 Aug 26 08:52:37.081436 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 51/88] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:36 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:37.184123 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1725fc38-7453-468b-9651-80688dc291b6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:37.185466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1725fc38-7453-468b-9651-80688dc291b6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:37.196543 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1725fc38-7453-468b-9651-80688dc291b6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:37.197361 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1725fc38-7453-468b-9651-80688dc291b6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:37.198178 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1725fc38-7453-468b-9651-80688dc291b6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:37.199533 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1725fc38-7453-468b-9651-80688dc291b6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:37.200433 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1725fc38-7453-468b-9651-80688dc291b6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:37.201513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1725fc38-7453-468b-9651-80688dc291b6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:37.464520 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1725fc38-7453-468b-9651-80688dc291b6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:37.468187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=100 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:37.476674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1725fc38-7453-468b-9651-80688dc291b6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 0.299609 Aug 26 08:52:37.477318 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 38/89] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:37 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:52:37.843882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-959e320d-6db2-4878-ba83-b6334c9fb3a4 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:37.844858 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-959e320d-6db2-4878-ba83-b6334c9fb3a4 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:37.870725 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-959e320d-6db2-4878-ba83-b6334c9fb3a4 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:37.875827 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-959e320d-6db2-4878-ba83-b6334c9fb3a4 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:37.877202 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-959e320d-6db2-4878-ba83-b6334c9fb3a4 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:37.878688 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-959e320d-6db2-4878-ba83-b6334c9fb3a4 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:37.879617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-959e320d-6db2-4878-ba83-b6334c9fb3a4 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:37.886030 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-959e320d-6db2-4878-ba83-b6334c9fb3a4 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:37.948019 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0c3ef138-e5fd-4e11-b7b4-fc68748a86c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:37.949340 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0c3ef138-e5fd-4e11-b7b4-fc68748a86c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:37.961673 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0c3ef138-e5fd-4e11-b7b4-fc68748a86c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:37.962285 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0c3ef138-e5fd-4e11-b7b4-fc68748a86c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:37.971380 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0c3ef138-e5fd-4e11-b7b4-fc68748a86c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:37.975987 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0c3ef138-e5fd-4e11-b7b4-fc68748a86c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:37.976913 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0c3ef138-e5fd-4e11-b7b4-fc68748a86c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:37.977727 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0c3ef138-e5fd-4e11-b7b4-fc68748a86c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:38.246672 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0c3ef138-e5fd-4e11-b7b4-fc68748a86c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:38.262178 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0c3ef138-e5fd-4e11-b7b4-fc68748a86c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:38.272860 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-959e320d-6db2-4878-ba83-b6334c9fb3a4 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:38.279718 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0c3ef138-e5fd-4e11-b7b4-fc68748a86c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:38.286861 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0c3ef138-e5fd-4e11-b7b4-fc68748a86c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.346777 Aug 26 08:52:38.288350 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 39/90] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:37 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:38.295560 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2f1d5268-ed16-42a8-a036-7d9b74856fbf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:38.297017 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2f1d5268-ed16-42a8-a036-7d9b74856fbf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:38.304374 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2f1d5268-ed16-42a8-a036-7d9b74856fbf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:38.305179 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2f1d5268-ed16-42a8-a036-7d9b74856fbf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:38.305793 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2f1d5268-ed16-42a8-a036-7d9b74856fbf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:38.306841 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2f1d5268-ed16-42a8-a036-7d9b74856fbf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:38.307556 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2f1d5268-ed16-42a8-a036-7d9b74856fbf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:38.308242 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2f1d5268-ed16-42a8-a036-7d9b74856fbf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:38.314723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-959e320d-6db2-4878-ba83-b6334c9fb3a4 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.471874 Aug 26 08:52:38.324013 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 52/91] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:37 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:38.350140 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-48afde9c-cbab-4f73-bca4-f5e2611f99dc req-df2b278d-2db0-472a-81de-5dfc73a73f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ea47a3-6a48-4509-8799-634e4e77319c", "name": "network-vif-plugged", "status": "completed", "tag": "f2f9abb5-5c56-40e3-aed3-5d7eb434f36c"}, {"server_uuid": "a0b14a44-0641-4121-9855-fe0454700263", "name": "network-vif-plugged", "status": "completed", "tag": "e6c43102-4bd4-4b6b-8992-a1b7bca6db2b"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:38.417471 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-48afde9c-cbab-4f73-bca4-f5e2611f99dc req-df2b278d-2db0-472a-81de-5dfc73a73f36 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:38.434722 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-48afde9c-cbab-4f73-bca4-f5e2611f99dc req-df2b278d-2db0-472a-81de-5dfc73a73f36 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:38.439851 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-48afde9c-cbab-4f73-bca4-f5e2611f99dc req-df2b278d-2db0-472a-81de-5dfc73a73f36 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:38.498703 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-48afde9c-cbab-4f73-bca4-f5e2611f99dc req-df2b278d-2db0-472a-81de-5dfc73a73f36 service nova] Creating event network-vif-plugged:f2f9abb5-5c56-40e3-aed3-5d7eb434f36c for instance 14ea47a3-6a48-4509-8799-634e4e77319c on hv-cinder-85236 Aug 26 08:52:38.500723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-48afde9c-cbab-4f73-bca4-f5e2611f99dc req-df2b278d-2db0-472a-81de-5dfc73a73f36 service nova] Creating event network-vif-plugged:e6c43102-4bd4-4b6b-8992-a1b7bca6db2b for instance a0b14a44-0641-4121-9855-fe0454700263 on hv-cinder-85236 Aug 26 08:52:38.522586 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-48afde9c-cbab-4f73-bca4-f5e2611f99dc req-df2b278d-2db0-472a-81de-5dfc73a73f36 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.193632 Aug 26 08:52:38.527040 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 53/92] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:52:38.543010 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-cece0bb6-cded-4be2-b8c0-24361f1a9fcf tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:38.543896 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-cece0bb6-cded-4be2-b8c0-24361f1a9fcf tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:38.595716 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cece0bb6-cded-4be2-b8c0-24361f1a9fcf tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:38.596713 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cece0bb6-cded-4be2-b8c0-24361f1a9fcf tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:38.597141 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cece0bb6-cded-4be2-b8c0-24361f1a9fcf tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:38.597884 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cece0bb6-cded-4be2-b8c0-24361f1a9fcf tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:38.600206 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cece0bb6-cded-4be2-b8c0-24361f1a9fcf tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:38.601936 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cece0bb6-cded-4be2-b8c0-24361f1a9fcf tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:38.635534 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2f1d5268-ed16-42a8-a036-7d9b74856fbf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:38.646761 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2f1d5268-ed16-42a8-a036-7d9b74856fbf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1321 microversion: 2.1 time: 0.357147 Aug 26 08:52:38.647778 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 40/93] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:38 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:38.851506 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-cece0bb6-cded-4be2-b8c0-24361f1a9fcf tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:38.859880 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-cece0bb6-cded-4be2-b8c0-24361f1a9fcf tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 0.330907 Aug 26 08:52:38.874387 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 54/94] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:38 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:39.330018 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0f0821ac-4775-4a94-87aa-c57e36636aad tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:39.331065 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0f0821ac-4775-4a94-87aa-c57e36636aad tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:39.346165 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f0821ac-4775-4a94-87aa-c57e36636aad tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:39.346913 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f0821ac-4775-4a94-87aa-c57e36636aad tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:39.347884 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f0821ac-4775-4a94-87aa-c57e36636aad tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:39.349063 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f0821ac-4775-4a94-87aa-c57e36636aad tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:39.349400 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4f493b36-d7cb-4467-a4be-d5e6272ef6dd tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:39.349827 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f0821ac-4775-4a94-87aa-c57e36636aad tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:39.350385 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4f493b36-d7cb-4467-a4be-d5e6272ef6dd tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:39.350520 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f0821ac-4775-4a94-87aa-c57e36636aad tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:39.380933 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f493b36-d7cb-4467-a4be-d5e6272ef6dd tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:39.381811 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f493b36-d7cb-4467-a4be-d5e6272ef6dd tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:39.383846 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f493b36-d7cb-4467-a4be-d5e6272ef6dd tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:39.385180 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f493b36-d7cb-4467-a4be-d5e6272ef6dd tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:39.386015 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f493b36-d7cb-4467-a4be-d5e6272ef6dd tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:39.386762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f493b36-d7cb-4467-a4be-d5e6272ef6dd tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:39.636598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0f0821ac-4775-4a94-87aa-c57e36636aad tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:39.655020 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0f0821ac-4775-4a94-87aa-c57e36636aad tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:39.657009 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0f0821ac-4775-4a94-87aa-c57e36636aad tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:39.658436 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0f0821ac-4775-4a94-87aa-c57e36636aad tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.335757 Aug 26 08:52:39.676877 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 41/95] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:39 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:39.677506 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-4f493b36-d7cb-4467-a4be-d5e6272ef6dd tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:39.688602 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a109e821-d1b3-4bfb-a488-4834d01b2834 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:39.689868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a109e821-d1b3-4bfb-a488-4834d01b2834 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:39.705472 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4f493b36-d7cb-4467-a4be-d5e6272ef6dd tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.360512 Aug 26 08:52:39.708036 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 55/96] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:39 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:39.722083 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a109e821-d1b3-4bfb-a488-4834d01b2834 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:39.724322 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a109e821-d1b3-4bfb-a488-4834d01b2834 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:39.727583 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a109e821-d1b3-4bfb-a488-4834d01b2834 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:39.732562 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a109e821-d1b3-4bfb-a488-4834d01b2834 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:39.733428 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a109e821-d1b3-4bfb-a488-4834d01b2834 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:39.734060 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a109e821-d1b3-4bfb-a488-4834d01b2834 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:39.887552 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-eecbb296-3a6b-424c-8f78-14ad682d186b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:39.890188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-eecbb296-3a6b-424c-8f78-14ad682d186b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:39.901902 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eecbb296-3a6b-424c-8f78-14ad682d186b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:39.903751 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eecbb296-3a6b-424c-8f78-14ad682d186b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:39.905681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eecbb296-3a6b-424c-8f78-14ad682d186b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:39.908050 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eecbb296-3a6b-424c-8f78-14ad682d186b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:39.909226 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eecbb296-3a6b-424c-8f78-14ad682d186b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:39.910275 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eecbb296-3a6b-424c-8f78-14ad682d186b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:40.028117 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a109e821-d1b3-4bfb-a488-4834d01b2834 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:40.039084 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a109e821-d1b3-4bfb-a488-4834d01b2834 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1321 microversion: 2.1 time: 0.357749 Aug 26 08:52:40.039777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 42/97] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:39 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:52:40.701922 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ce1f2e91-6928-42af-b566-39a9658c5ae1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:40.702580 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ce1f2e91-6928-42af-b566-39a9658c5ae1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:40.714810 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce1f2e91-6928-42af-b566-39a9658c5ae1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:40.715678 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce1f2e91-6928-42af-b566-39a9658c5ae1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:40.717014 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce1f2e91-6928-42af-b566-39a9658c5ae1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:40.717960 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce1f2e91-6928-42af-b566-39a9658c5ae1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:40.718562 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce1f2e91-6928-42af-b566-39a9658c5ae1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:40.719361 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce1f2e91-6928-42af-b566-39a9658c5ae1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:40.790980 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-eecbb296-3a6b-424c-8f78-14ad682d186b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:40.791322 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-eecbb296-3a6b-424c-8f78-14ad682d186b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 0.908741 Aug 26 08:52:40.794831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 56/98] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:39 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:52:40.808328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ab6819f9-1afe-46ec-b6d7-95478ebdff87 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:40.811588 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ab6819f9-1afe-46ec-b6d7-95478ebdff87 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:40.825743 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab6819f9-1afe-46ec-b6d7-95478ebdff87 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:40.826487 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab6819f9-1afe-46ec-b6d7-95478ebdff87 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:40.827262 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab6819f9-1afe-46ec-b6d7-95478ebdff87 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:40.828001 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab6819f9-1afe-46ec-b6d7-95478ebdff87 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:40.828704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab6819f9-1afe-46ec-b6d7-95478ebdff87 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:40.829391 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab6819f9-1afe-46ec-b6d7-95478ebdff87 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:41.028047 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ce1f2e91-6928-42af-b566-39a9658c5ae1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:41.047052 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ab6819f9-1afe-46ec-b6d7-95478ebdff87 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:41.059036 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ce1f2e91-6928-42af-b566-39a9658c5ae1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:41.061578 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ce1f2e91-6928-42af-b566-39a9658c5ae1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:41.066698 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ce1f2e91-6928-42af-b566-39a9658c5ae1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.371430 Aug 26 08:52:41.077889 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ab6819f9-1afe-46ec-b6d7-95478ebdff87 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.281181 Aug 26 08:52:41.082589 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 57/99] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:40 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:41.091993 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 43/100] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:40 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:41.097213 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-297fa21c-e766-4ef0-95e1-7909805a3039 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:41.102856 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-297fa21c-e766-4ef0-95e1-7909805a3039 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:41.126648 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-297fa21c-e766-4ef0-95e1-7909805a3039 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:41.128498 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-297fa21c-e766-4ef0-95e1-7909805a3039 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:41.129320 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-297fa21c-e766-4ef0-95e1-7909805a3039 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:41.130654 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-297fa21c-e766-4ef0-95e1-7909805a3039 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:41.131615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-297fa21c-e766-4ef0-95e1-7909805a3039 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:41.132360 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-297fa21c-e766-4ef0-95e1-7909805a3039 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:41.384858 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-297fa21c-e766-4ef0-95e1-7909805a3039 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:41.415760 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-297fa21c-e766-4ef0-95e1-7909805a3039 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1321 microversion: 2.1 time: 0.330651 Aug 26 08:52:41.416843 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 58/101] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:41 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:41.820702 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-19cf624b-72cd-47c2-a98e-658998b6a497 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:41.821316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-19cf624b-72cd-47c2-a98e-658998b6a497 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:41.829994 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19cf624b-72cd-47c2-a98e-658998b6a497 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:41.830487 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19cf624b-72cd-47c2-a98e-658998b6a497 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:41.830935 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19cf624b-72cd-47c2-a98e-658998b6a497 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:41.831669 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19cf624b-72cd-47c2-a98e-658998b6a497 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:41.832129 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19cf624b-72cd-47c2-a98e-658998b6a497 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:41.832683 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19cf624b-72cd-47c2-a98e-658998b6a497 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:42.014187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-19cf624b-72cd-47c2-a98e-658998b6a497 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:42.023437 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-19cf624b-72cd-47c2-a98e-658998b6a497 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1364 microversion: 2.1 time: 0.207814 Aug 26 08:52:42.024933 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 44/102] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:41 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:42.094916 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-83f3eea8-a63d-492e-a690-60839cd97149 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:42.095800 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-83f3eea8-a63d-492e-a690-60839cd97149 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:42.106471 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4aab74a8-e21e-4ca6-9315-e9022b8e03d1 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:42.107678 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4aab74a8-e21e-4ca6-9315-e9022b8e03d1 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:42.115012 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-83f3eea8-a63d-492e-a690-60839cd97149 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:42.115563 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-83f3eea8-a63d-492e-a690-60839cd97149 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:42.116231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-83f3eea8-a63d-492e-a690-60839cd97149 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:42.116951 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-83f3eea8-a63d-492e-a690-60839cd97149 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:42.129503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4aab74a8-e21e-4ca6-9315-e9022b8e03d1 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:42.129939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-83f3eea8-a63d-492e-a690-60839cd97149 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:42.130676 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-83f3eea8-a63d-492e-a690-60839cd97149 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:42.131524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4aab74a8-e21e-4ca6-9315-e9022b8e03d1 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:42.135403 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4aab74a8-e21e-4ca6-9315-e9022b8e03d1 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:42.136440 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4aab74a8-e21e-4ca6-9315-e9022b8e03d1 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:42.137142 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4aab74a8-e21e-4ca6-9315-e9022b8e03d1 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:42.137928 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4aab74a8-e21e-4ca6-9315-e9022b8e03d1 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:42.364770 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4aab74a8-e21e-4ca6-9315-e9022b8e03d1 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:42.375185 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4aab74a8-e21e-4ca6-9315-e9022b8e03d1 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1314 microversion: 2.1 time: 0.272544 Aug 26 08:52:42.378818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 45/103] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:42 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:52:42.383996 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-1dbb76d9-af5d-48c7-baf7-4a768970ad43 req-95df4f0d-c131-4cb6-a163-172d2fee9d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0d2d4-3218-426b-a548-91c5891780fa", "name": "network-vif-plugged", "status": "completed", "tag": "61d58bf1-2d6c-4df7-8638-a30df721d2e9"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:42.399416 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-1dbb76d9-af5d-48c7-baf7-4a768970ad43 req-95df4f0d-c131-4cb6-a163-172d2fee9d9b service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:42.400203 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-1dbb76d9-af5d-48c7-baf7-4a768970ad43 req-95df4f0d-c131-4cb6-a163-172d2fee9d9b service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:42.400784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-1dbb76d9-af5d-48c7-baf7-4a768970ad43 req-95df4f0d-c131-4cb6-a163-172d2fee9d9b service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:42.418576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-1dbb76d9-af5d-48c7-baf7-4a768970ad43 req-95df4f0d-c131-4cb6-a163-172d2fee9d9b service nova] Creating event network-vif-plugged:61d58bf1-2d6c-4df7-8638-a30df721d2e9 for instance 8de0d2d4-3218-426b-a548-91c5891780fa on hv-cinder-85236 Aug 26 08:52:42.426165 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-1dbb76d9-af5d-48c7-baf7-4a768970ad43 req-95df4f0d-c131-4cb6-a163-172d2fee9d9b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045744 Aug 26 08:52:42.427483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 46/104] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:52:42.450076 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-36faaf3e-6771-4e5b-aca8-30fe25d1c1c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:42.450825 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-36faaf3e-6771-4e5b-aca8-30fe25d1c1c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:42.458393 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-36faaf3e-6771-4e5b-aca8-30fe25d1c1c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:42.458857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-36faaf3e-6771-4e5b-aca8-30fe25d1c1c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:42.459306 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-36faaf3e-6771-4e5b-aca8-30fe25d1c1c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:42.460000 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-36faaf3e-6771-4e5b-aca8-30fe25d1c1c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:42.460436 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-36faaf3e-6771-4e5b-aca8-30fe25d1c1c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:42.461040 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-36faaf3e-6771-4e5b-aca8-30fe25d1c1c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:42.585436 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-83f3eea8-a63d-492e-a690-60839cd97149 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:42.598817 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-83f3eea8-a63d-492e-a690-60839cd97149 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:42.600918 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-83f3eea8-a63d-492e-a690-60839cd97149 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:42.602602 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-83f3eea8-a63d-492e-a690-60839cd97149 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.514302 Aug 26 08:52:42.604801 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 59/105] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:42 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:42.704013 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-36faaf3e-6771-4e5b-aca8-30fe25d1c1c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:42.717114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-36faaf3e-6771-4e5b-aca8-30fe25d1c1c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1321 microversion: 2.1 time: 0.275875 Aug 26 08:52:42.718280 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 47/106] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:42 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:52:43.046558 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-562f4b81-6771-48b6-8912-509d5885fd01 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:43.047478 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-562f4b81-6771-48b6-8912-509d5885fd01 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:43.061974 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-562f4b81-6771-48b6-8912-509d5885fd01 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:43.062474 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-562f4b81-6771-48b6-8912-509d5885fd01 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:43.063419 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-562f4b81-6771-48b6-8912-509d5885fd01 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:43.064752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-562f4b81-6771-48b6-8912-509d5885fd01 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:43.065175 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-562f4b81-6771-48b6-8912-509d5885fd01 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:43.065597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-562f4b81-6771-48b6-8912-509d5885fd01 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:43.272699 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-562f4b81-6771-48b6-8912-509d5885fd01 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:43.283398 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-562f4b81-6771-48b6-8912-509d5885fd01 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1551 microversion: 2.1 time: 0.240258 Aug 26 08:52:43.284701 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 60/107] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:43 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1551 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:43.342822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7b5cfe25-500e-44e5-93f6-42e8301bef2e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:43.344546 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-7b5cfe25-500e-44e5-93f6-42e8301bef2e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:43.376198 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7b5cfe25-500e-44e5-93f6-42e8301bef2e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:43.376730 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7b5cfe25-500e-44e5-93f6-42e8301bef2e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:43.377175 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7b5cfe25-500e-44e5-93f6-42e8301bef2e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:43.377922 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7b5cfe25-500e-44e5-93f6-42e8301bef2e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:43.378383 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7b5cfe25-500e-44e5-93f6-42e8301bef2e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:43.378813 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7b5cfe25-500e-44e5-93f6-42e8301bef2e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:43.417207 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b4c3a718-2fe9-42a3-8f63-39786ab682ef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:43.425397 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b4c3a718-2fe9-42a3-8f63-39786ab682ef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:43.432474 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4c3a718-2fe9-42a3-8f63-39786ab682ef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:43.436048 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4c3a718-2fe9-42a3-8f63-39786ab682ef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:43.437064 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4c3a718-2fe9-42a3-8f63-39786ab682ef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:43.438039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4c3a718-2fe9-42a3-8f63-39786ab682ef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:43.440531 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4c3a718-2fe9-42a3-8f63-39786ab682ef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:43.441074 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4c3a718-2fe9-42a3-8f63-39786ab682ef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:43.566117 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7b5cfe25-500e-44e5-93f6-42e8301bef2e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.248940 Aug 26 08:52:43.566732 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 48/108] 10.222.0.71 () {58 vars in 1275 bytes} [Fri Aug 26 08:52:43 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/os-interface => generated 285 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:52:43.640912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e71b2351-c3a3-4a02-8c65-1d044b51ece1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:43.641523 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e71b2351-c3a3-4a02-8c65-1d044b51ece1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:43.650227 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e71b2351-c3a3-4a02-8c65-1d044b51ece1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:43.650876 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e71b2351-c3a3-4a02-8c65-1d044b51ece1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:43.651493 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e71b2351-c3a3-4a02-8c65-1d044b51ece1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:43.653200 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e71b2351-c3a3-4a02-8c65-1d044b51ece1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:43.654830 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e71b2351-c3a3-4a02-8c65-1d044b51ece1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:43.655965 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e71b2351-c3a3-4a02-8c65-1d044b51ece1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:43.683829 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b4c3a718-2fe9-42a3-8f63-39786ab682ef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:43.697542 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b4c3a718-2fe9-42a3-8f63-39786ab682ef tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1501 microversion: 2.1 time: 0.298218 Aug 26 08:52:43.699665 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 61/109] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:43 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1501 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:43.745145 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b3a439eb-d1a5-40c6-a7f9-bb3c47fd14aa tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:43.746262 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b3a439eb-d1a5-40c6-a7f9-bb3c47fd14aa tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:43.757471 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b3a439eb-d1a5-40c6-a7f9-bb3c47fd14aa tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:43.758445 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b3a439eb-d1a5-40c6-a7f9-bb3c47fd14aa tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:43.759190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b3a439eb-d1a5-40c6-a7f9-bb3c47fd14aa tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:43.760180 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b3a439eb-d1a5-40c6-a7f9-bb3c47fd14aa tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:43.760653 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b3a439eb-d1a5-40c6-a7f9-bb3c47fd14aa tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:43.761032 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b3a439eb-d1a5-40c6-a7f9-bb3c47fd14aa tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:43.764917 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=100 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:43.999682 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b3a439eb-d1a5-40c6-a7f9-bb3c47fd14aa tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:44.009936 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b3a439eb-d1a5-40c6-a7f9-bb3c47fd14aa tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1515 microversion: 2.1 time: 0.269643 Aug 26 08:52:44.011116 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 62/110] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:43 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1515 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:44.039450 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e71b2351-c3a3-4a02-8c65-1d044b51ece1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:44.042333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1a267536-e6b0-4a78-b141-00d67d5726f4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:44.044872 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1a267536-e6b0-4a78-b141-00d67d5726f4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:44.051933 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a267536-e6b0-4a78-b141-00d67d5726f4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:44.052428 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a267536-e6b0-4a78-b141-00d67d5726f4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:44.052919 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a267536-e6b0-4a78-b141-00d67d5726f4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:44.053573 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a267536-e6b0-4a78-b141-00d67d5726f4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:44.054018 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a267536-e6b0-4a78-b141-00d67d5726f4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:44.054426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a267536-e6b0-4a78-b141-00d67d5726f4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:44.054914 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e71b2351-c3a3-4a02-8c65-1d044b51ece1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:44.062503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e71b2351-c3a3-4a02-8c65-1d044b51ece1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:44.062503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e71b2351-c3a3-4a02-8c65-1d044b51ece1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.423860 Aug 26 08:52:44.062503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 49/111] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:43 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:44.151309 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-1a267536-e6b0-4a78-b141-00d67d5726f4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lazy-loading 'flavor' on Instance uuid 14ea47a3-6a48-4509-8799-634e4e77319c {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:52:44.414022 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1a267536-e6b0-4a78-b141-00d67d5726f4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "POST /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c/action" status: 200 len: 32 microversion: 2.1 time: 0.377690 Aug 26 08:52:44.419360 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 63/112] 10.222.0.71 () {60 vars in 1278 bytes} [Fri Aug 26 08:52:44 2022] POST /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c/action => generated 32 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 08:52:44.437232 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-203ee6e0-dd1c-4208-97d8-4955c85956d4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:44.439820 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-203ee6e0-dd1c-4208-97d8-4955c85956d4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:44.454117 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-203ee6e0-dd1c-4208-97d8-4955c85956d4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:44.455867 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-203ee6e0-dd1c-4208-97d8-4955c85956d4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:44.457129 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-203ee6e0-dd1c-4208-97d8-4955c85956d4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:44.458462 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-203ee6e0-dd1c-4208-97d8-4955c85956d4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:44.459832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-203ee6e0-dd1c-4208-97d8-4955c85956d4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:44.460667 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-203ee6e0-dd1c-4208-97d8-4955c85956d4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:45.009977 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-203ee6e0-dd1c-4208-97d8-4955c85956d4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:45.021565 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-203ee6e0-dd1c-4208-97d8-4955c85956d4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.593013 Aug 26 08:52:45.023437 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 50/113] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:44 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:45.098708 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ed4e3fff-4d4c-4096-9a88-d44eaef0080e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:45.099865 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ed4e3fff-4d4c-4096-9a88-d44eaef0080e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:45.110024 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ed4e3fff-4d4c-4096-9a88-d44eaef0080e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:45.111199 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ed4e3fff-4d4c-4096-9a88-d44eaef0080e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:45.111983 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ed4e3fff-4d4c-4096-9a88-d44eaef0080e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:45.113892 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ed4e3fff-4d4c-4096-9a88-d44eaef0080e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:45.114633 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ed4e3fff-4d4c-4096-9a88-d44eaef0080e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:45.115298 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ed4e3fff-4d4c-4096-9a88-d44eaef0080e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:45.461591 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0f2151b5-66ec-4e4f-8816-a12452aac1bc tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3670c28-69d3-4918-a5bb-24fc711fc293"}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:45.469031 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0f2151b5-66ec-4e4f-8816-a12452aac1bc tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:45.481064 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=82 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:45.484200 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f2151b5-66ec-4e4f-8816-a12452aac1bc tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:45.485115 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f2151b5-66ec-4e4f-8816-a12452aac1bc tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:45.486244 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f2151b5-66ec-4e4f-8816-a12452aac1bc tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:45.487547 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f2151b5-66ec-4e4f-8816-a12452aac1bc tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:45.488409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f2151b5-66ec-4e4f-8816-a12452aac1bc tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:45.489033 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f2151b5-66ec-4e4f-8816-a12452aac1bc tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:45.546305 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ed4e3fff-4d4c-4096-9a88-d44eaef0080e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:45.566685 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ed4e3fff-4d4c-4096-9a88-d44eaef0080e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:45.576094 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ed4e3fff-4d4c-4096-9a88-d44eaef0080e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:45.591912 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ed4e3fff-4d4c-4096-9a88-d44eaef0080e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.494900 Aug 26 08:52:45.614220 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 64/114] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:45 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:52:46.033665 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-c49538ae-f6bf-418b-bbc4-4dbaf000502a req-d9e5e686-a73a-4e20-82c4-618a0c3df60c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18845e10-a764-495f-b6fb-9b0858c695af", "tag": "bacb0225-80ef-4914-92a8-9314236edf1a"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:46.044719 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-c49538ae-f6bf-418b-bbc4-4dbaf000502a req-d9e5e686-a73a-4e20-82c4-618a0c3df60c service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:46.045627 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-c49538ae-f6bf-418b-bbc4-4dbaf000502a req-d9e5e686-a73a-4e20-82c4-618a0c3df60c service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:46.046302 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-c49538ae-f6bf-418b-bbc4-4dbaf000502a req-d9e5e686-a73a-4e20-82c4-618a0c3df60c service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:46.061910 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-c49538ae-f6bf-418b-bbc4-4dbaf000502a req-d9e5e686-a73a-4e20-82c4-618a0c3df60c service nova] Creating event network-changed:bacb0225-80ef-4914-92a8-9314236edf1a for instance 18845e10-a764-495f-b6fb-9b0858c695af on hv-cinder-85236 Aug 26 08:52:46.069016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-c49538ae-f6bf-418b-bbc4-4dbaf000502a req-d9e5e686-a73a-4e20-82c4-618a0c3df60c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039692 Aug 26 08:52:46.073895 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 65/115] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:52:46.080495 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-5391fb17-2e96-44ba-9843-a054362de835 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:46.081373 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-5391fb17-2e96-44ba-9843-a054362de835 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:46.087946 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5391fb17-2e96-44ba-9843-a054362de835 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:46.088643 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5391fb17-2e96-44ba-9843-a054362de835 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:46.089128 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5391fb17-2e96-44ba-9843-a054362de835 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:46.089944 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5391fb17-2e96-44ba-9843-a054362de835 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:46.090551 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5391fb17-2e96-44ba-9843-a054362de835 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:46.091297 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5391fb17-2e96-44ba-9843-a054362de835 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:46.413441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0f2151b5-66ec-4e4f-8816-a12452aac1bc tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "POST /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.958939 Aug 26 08:52:46.414731 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 51/116] 10.222.0.71 () {60 vars in 1323 bytes} [Fri Aug 26 08:52:45 2022] POST /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263/os-volume_attachments => generated 194 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:52:46.457464 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-5391fb17-2e96-44ba-9843-a054362de835 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:46.470498 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-5391fb17-2e96-44ba-9843-a054362de835 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.393711 Aug 26 08:52:46.471725 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 66/117] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:46 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:46.654568 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9832f142-a706-4ee1-a0d9-15682790dfe0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:46.656966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9832f142-a706-4ee1-a0d9-15682790dfe0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:46.666349 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9832f142-a706-4ee1-a0d9-15682790dfe0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:46.666836 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9832f142-a706-4ee1-a0d9-15682790dfe0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:46.667904 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9832f142-a706-4ee1-a0d9-15682790dfe0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:46.669403 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9832f142-a706-4ee1-a0d9-15682790dfe0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:46.670071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9832f142-a706-4ee1-a0d9-15682790dfe0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:46.670783 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9832f142-a706-4ee1-a0d9-15682790dfe0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:46.912243 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9832f142-a706-4ee1-a0d9-15682790dfe0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:46.922902 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9832f142-a706-4ee1-a0d9-15682790dfe0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:46.924397 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9832f142-a706-4ee1-a0d9-15682790dfe0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:46.925821 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9832f142-a706-4ee1-a0d9-15682790dfe0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1406 microversion: 2.20 time: 0.277756 Aug 26 08:52:46.926869 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 52/118] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:46 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:47.516373 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-84b63db6-2012-4929-9e38-44375357e10c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:47.517127 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-84b63db6-2012-4929-9e38-44375357e10c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:47.531194 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84b63db6-2012-4929-9e38-44375357e10c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:47.532935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84b63db6-2012-4929-9e38-44375357e10c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:47.534491 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84b63db6-2012-4929-9e38-44375357e10c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:47.536587 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84b63db6-2012-4929-9e38-44375357e10c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:47.545974 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84b63db6-2012-4929-9e38-44375357e10c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:47.546953 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84b63db6-2012-4929-9e38-44375357e10c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:47.905238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-84b63db6-2012-4929-9e38-44375357e10c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:47.926306 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-84b63db6-2012-4929-9e38-44375357e10c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.436697 Aug 26 08:52:47.929112 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 67/119] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:47 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:47.958232 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7786b105-7597-4e5e-837f-41c239d26519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:47.959431 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-7786b105-7597-4e5e-837f-41c239d26519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:47.973999 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7786b105-7597-4e5e-837f-41c239d26519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:47.974934 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7786b105-7597-4e5e-837f-41c239d26519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:47.975864 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7786b105-7597-4e5e-837f-41c239d26519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:47.977058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7786b105-7597-4e5e-837f-41c239d26519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:47.977665 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7786b105-7597-4e5e-837f-41c239d26519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:47.978391 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7786b105-7597-4e5e-837f-41c239d26519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:48.158409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-7786b105-7597-4e5e-837f-41c239d26519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:48.174280 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-7786b105-7597-4e5e-837f-41c239d26519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:48.175774 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-7786b105-7597-4e5e-837f-41c239d26519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:48.178000 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7786b105-7597-4e5e-837f-41c239d26519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1597 microversion: 2.20 time: 0.231047 Aug 26 08:52:48.190920 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 53/120] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:52:47 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1597 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:52:48.203175 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8030f2bc-c154-4f97-8023-033989636500 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:48.204137 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8030f2bc-c154-4f97-8023-033989636500 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:48.217790 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8030f2bc-c154-4f97-8023-033989636500 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:48.218355 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8030f2bc-c154-4f97-8023-033989636500 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:48.218801 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8030f2bc-c154-4f97-8023-033989636500 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:48.219596 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8030f2bc-c154-4f97-8023-033989636500 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:48.220154 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8030f2bc-c154-4f97-8023-033989636500 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:48.221778 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8030f2bc-c154-4f97-8023-033989636500 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:48.394267 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8030f2bc-c154-4f97-8023-033989636500 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.194617 Aug 26 08:52:48.394267 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 68/121] 10.222.0.71 () {60 vars in 1316 bytes} [Fri Aug 26 08:52:48 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:52:48.959820 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-624b67b8-fd86-432e-965c-5d7785cac2c4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:48.962854 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-624b67b8-fd86-432e-965c-5d7785cac2c4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:48.977632 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-624b67b8-fd86-432e-965c-5d7785cac2c4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:48.979584 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-624b67b8-fd86-432e-965c-5d7785cac2c4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:48.980443 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-624b67b8-fd86-432e-965c-5d7785cac2c4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:48.982129 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-624b67b8-fd86-432e-965c-5d7785cac2c4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:48.982966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-624b67b8-fd86-432e-965c-5d7785cac2c4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:48.985582 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-624b67b8-fd86-432e-965c-5d7785cac2c4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:49.329897 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-624b67b8-fd86-432e-965c-5d7785cac2c4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:49.341515 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-624b67b8-fd86-432e-965c-5d7785cac2c4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.386998 Aug 26 08:52:49.342925 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 54/122] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:48 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:50.368865 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-48bc8ba8-12c0-433d-8142-c5311456e417 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:50.371143 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-48bc8ba8-12c0-433d-8142-c5311456e417 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:50.388054 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-48bc8ba8-12c0-433d-8142-c5311456e417 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:50.389131 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-48bc8ba8-12c0-433d-8142-c5311456e417 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:50.389609 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-48bc8ba8-12c0-433d-8142-c5311456e417 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:50.390552 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-48bc8ba8-12c0-433d-8142-c5311456e417 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:50.391047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-48bc8ba8-12c0-433d-8142-c5311456e417 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:50.391653 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-48bc8ba8-12c0-433d-8142-c5311456e417 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:50.470714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-c6735810-3003-4ada-8b44-c7c7fd9b9d77 req-96708e0c-5c1b-4ed9-b78d-30fdbb19b372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de0d2d4-3218-426b-a548-91c5891780fa", "tag": "61d58bf1-2d6c-4df7-8638-a30df721d2e9"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:52:50.485611 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-c6735810-3003-4ada-8b44-c7c7fd9b9d77 req-96708e0c-5c1b-4ed9-b78d-30fdbb19b372 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:50.486336 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-c6735810-3003-4ada-8b44-c7c7fd9b9d77 req-96708e0c-5c1b-4ed9-b78d-30fdbb19b372 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:50.487074 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-c6735810-3003-4ada-8b44-c7c7fd9b9d77 req-96708e0c-5c1b-4ed9-b78d-30fdbb19b372 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:50.494810 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:50.522801 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-c6735810-3003-4ada-8b44-c7c7fd9b9d77 req-96708e0c-5c1b-4ed9-b78d-30fdbb19b372 service nova] Creating event network-changed:61d58bf1-2d6c-4df7-8638-a30df721d2e9 for instance 8de0d2d4-3218-426b-a548-91c5891780fa on hv-cinder-85236 Aug 26 08:52:50.533685 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-c6735810-3003-4ada-8b44-c7c7fd9b9d77 req-96708e0c-5c1b-4ed9-b78d-30fdbb19b372 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068358 Aug 26 08:52:50.543266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 55/123] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:52:50.688242 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-48bc8ba8-12c0-433d-8142-c5311456e417 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:50.706162 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-48bc8ba8-12c0-433d-8142-c5311456e417 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.345451 Aug 26 08:52:50.727601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 69/124] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:50 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:51.746930 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ca716223-1270-47ff-9598-f578920ad790 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:51.747700 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ca716223-1270-47ff-9598-f578920ad790 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:51.762216 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca716223-1270-47ff-9598-f578920ad790 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:51.768741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca716223-1270-47ff-9598-f578920ad790 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:51.769221 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca716223-1270-47ff-9598-f578920ad790 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:51.770642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca716223-1270-47ff-9598-f578920ad790 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:51.772093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca716223-1270-47ff-9598-f578920ad790 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:51.772746 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca716223-1270-47ff-9598-f578920ad790 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:52.086691 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ca716223-1270-47ff-9598-f578920ad790 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:52.095491 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ca716223-1270-47ff-9598-f578920ad790 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.357072 Aug 26 08:52:52.096093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 56/125] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:51 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:53.121053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-27715b59-766b-48bb-bf01-707ae8000c03 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:53.122121 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-27715b59-766b-48bb-bf01-707ae8000c03 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:53.126999 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=88 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:52:53.133353 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27715b59-766b-48bb-bf01-707ae8000c03 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:53.135386 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27715b59-766b-48bb-bf01-707ae8000c03 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:53.136647 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27715b59-766b-48bb-bf01-707ae8000c03 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:53.137784 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27715b59-766b-48bb-bf01-707ae8000c03 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:53.138408 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27715b59-766b-48bb-bf01-707ae8000c03 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:53.139078 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27715b59-766b-48bb-bf01-707ae8000c03 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:53.320695 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-27715b59-766b-48bb-bf01-707ae8000c03 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:53.330724 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-27715b59-766b-48bb-bf01-707ae8000c03 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.216803 Aug 26 08:52:53.331332 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 70/126] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:53 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:54.357345 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c7ba51a3-ea9f-4b54-90f0-ab662ef28c1e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:54.358777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c7ba51a3-ea9f-4b54-90f0-ab662ef28c1e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:54.384182 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c7ba51a3-ea9f-4b54-90f0-ab662ef28c1e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:54.385214 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c7ba51a3-ea9f-4b54-90f0-ab662ef28c1e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:54.386948 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c7ba51a3-ea9f-4b54-90f0-ab662ef28c1e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:54.388746 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c7ba51a3-ea9f-4b54-90f0-ab662ef28c1e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:54.390323 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c7ba51a3-ea9f-4b54-90f0-ab662ef28c1e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:54.392159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c7ba51a3-ea9f-4b54-90f0-ab662ef28c1e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:54.632635 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c7ba51a3-ea9f-4b54-90f0-ab662ef28c1e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:54.645295 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c7ba51a3-ea9f-4b54-90f0-ab662ef28c1e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.295645 Aug 26 08:52:54.658926 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 57/127] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:54 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:55.686480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-13e5f8bc-bb2d-4702-973b-0d99793e1889 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:55.687565 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-13e5f8bc-bb2d-4702-973b-0d99793e1889 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:55.703514 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-13e5f8bc-bb2d-4702-973b-0d99793e1889 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:55.704006 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-13e5f8bc-bb2d-4702-973b-0d99793e1889 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:55.704443 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-13e5f8bc-bb2d-4702-973b-0d99793e1889 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:55.705161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-13e5f8bc-bb2d-4702-973b-0d99793e1889 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:55.705610 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-13e5f8bc-bb2d-4702-973b-0d99793e1889 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:55.706089 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-13e5f8bc-bb2d-4702-973b-0d99793e1889 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:55.945479 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-13e5f8bc-bb2d-4702-973b-0d99793e1889 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:55.960672 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-13e5f8bc-bb2d-4702-973b-0d99793e1889 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.277756 Aug 26 08:52:55.987093 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 71/128] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:55 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:57.012825 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ac9c1c19-c3c4-4f4b-8964-3268922e44a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:57.014829 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ac9c1c19-c3c4-4f4b-8964-3268922e44a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:57.025454 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ac9c1c19-c3c4-4f4b-8964-3268922e44a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:57.026193 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ac9c1c19-c3c4-4f4b-8964-3268922e44a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:57.026861 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ac9c1c19-c3c4-4f4b-8964-3268922e44a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:57.028003 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ac9c1c19-c3c4-4f4b-8964-3268922e44a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:57.028871 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ac9c1c19-c3c4-4f4b-8964-3268922e44a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:57.029577 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ac9c1c19-c3c4-4f4b-8964-3268922e44a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:57.277556 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ac9c1c19-c3c4-4f4b-8964-3268922e44a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:57.292132 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ac9c1c19-c3c4-4f4b-8964-3268922e44a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.289354 Aug 26 08:52:57.293062 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 58/129] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:57 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:57.638028 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-69e863de-cc50-487e-959d-024033cc0bd0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:57.640279 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-69e863de-cc50-487e-959d-024033cc0bd0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:57.649641 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69e863de-cc50-487e-959d-024033cc0bd0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:57.650621 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69e863de-cc50-487e-959d-024033cc0bd0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:57.651333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69e863de-cc50-487e-959d-024033cc0bd0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:57.652930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69e863de-cc50-487e-959d-024033cc0bd0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:57.653611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69e863de-cc50-487e-959d-024033cc0bd0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:57.654031 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69e863de-cc50-487e-959d-024033cc0bd0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:57.686189 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-69e863de-cc50-487e-959d-024033cc0bd0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Going to try to terminate instance {{(pid=132217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 08:52:57.786840 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-69e863de-cc50-487e-959d-024033cc0bd0 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "DELETE /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 204 len: 0 microversion: 2.1 time: 0.154494 Aug 26 08:52:57.787364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 72/130] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 08:52:57 2022] DELETE /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:52:57.796040 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3de44772-bc6e-4381-b7b5-d7d022fd9daa tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:57.796642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3de44772-bc6e-4381-b7b5-d7d022fd9daa tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:57.803369 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3de44772-bc6e-4381-b7b5-d7d022fd9daa tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:57.803844 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3de44772-bc6e-4381-b7b5-d7d022fd9daa tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:57.804269 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3de44772-bc6e-4381-b7b5-d7d022fd9daa tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:57.804960 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3de44772-bc6e-4381-b7b5-d7d022fd9daa tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:57.805407 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3de44772-bc6e-4381-b7b5-d7d022fd9daa tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:57.805819 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3de44772-bc6e-4381-b7b5-d7d022fd9daa tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:57.949868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3de44772-bc6e-4381-b7b5-d7d022fd9daa tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:57.959340 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3de44772-bc6e-4381-b7b5-d7d022fd9daa tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1553 microversion: 2.1 time: 0.167270 Aug 26 08:52:57.959926 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 59/131] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:57 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:58.326342 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1331c4f5-bb4a-4754-8066-419b34dfd7b1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:58.327220 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1331c4f5-bb4a-4754-8066-419b34dfd7b1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:58.333588 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1331c4f5-bb4a-4754-8066-419b34dfd7b1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:58.334058 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1331c4f5-bb4a-4754-8066-419b34dfd7b1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:58.334480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1331c4f5-bb4a-4754-8066-419b34dfd7b1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:58.335186 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1331c4f5-bb4a-4754-8066-419b34dfd7b1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:58.335623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1331c4f5-bb4a-4754-8066-419b34dfd7b1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:58.336031 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1331c4f5-bb4a-4754-8066-419b34dfd7b1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:58.496470 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1331c4f5-bb4a-4754-8066-419b34dfd7b1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:58.504953 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1331c4f5-bb4a-4754-8066-419b34dfd7b1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.182823 Aug 26 08:52:58.505551 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 73/132] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:58 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:58.980683 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1132f486-ace0-46c5-bd61-8d3a86abef51 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:58.981279 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1132f486-ace0-46c5-bd61-8d3a86abef51 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:58.988032 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1132f486-ace0-46c5-bd61-8d3a86abef51 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:58.988514 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1132f486-ace0-46c5-bd61-8d3a86abef51 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:58.988974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1132f486-ace0-46c5-bd61-8d3a86abef51 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:58.989691 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1132f486-ace0-46c5-bd61-8d3a86abef51 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:58.990116 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1132f486-ace0-46c5-bd61-8d3a86abef51 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:58.990533 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1132f486-ace0-46c5-bd61-8d3a86abef51 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:59.139623 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1132f486-ace0-46c5-bd61-8d3a86abef51 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:59.151057 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1132f486-ace0-46c5-bd61-8d3a86abef51 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1553 microversion: 2.1 time: 0.174018 Aug 26 08:52:59.151766 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 60/133] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:58 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:52:59.532319 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-01e0904d-bce8-42e1-b8fa-3353a285c7b3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:52:59.533410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-01e0904d-bce8-42e1-b8fa-3353a285c7b3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:52:59.543560 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01e0904d-bce8-42e1-b8fa-3353a285c7b3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:59.544597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01e0904d-bce8-42e1-b8fa-3353a285c7b3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:59.545107 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01e0904d-bce8-42e1-b8fa-3353a285c7b3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:59.546441 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01e0904d-bce8-42e1-b8fa-3353a285c7b3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:52:59.547254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01e0904d-bce8-42e1-b8fa-3353a285c7b3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:52:59.547970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01e0904d-bce8-42e1-b8fa-3353a285c7b3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:52:59.699712 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-01e0904d-bce8-42e1-b8fa-3353a285c7b3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:52:59.708441 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-01e0904d-bce8-42e1-b8fa-3353a285c7b3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.183710 Aug 26 08:52:59.709036 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 74/134] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:52:59 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:00.173216 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e1343978-fd51-4f8c-8974-bdb837bf477a tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:00.173829 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e1343978-fd51-4f8c-8974-bdb837bf477a tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:00.180996 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e1343978-fd51-4f8c-8974-bdb837bf477a tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:00.181485 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e1343978-fd51-4f8c-8974-bdb837bf477a tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:00.181918 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e1343978-fd51-4f8c-8974-bdb837bf477a tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:00.182627 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e1343978-fd51-4f8c-8974-bdb837bf477a tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:00.183135 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e1343978-fd51-4f8c-8974-bdb837bf477a tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:00.183560 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e1343978-fd51-4f8c-8974-bdb837bf477a tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:00.332154 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e1343978-fd51-4f8c-8974-bdb837bf477a tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:00.340450 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e1343978-fd51-4f8c-8974-bdb837bf477a tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1553 microversion: 2.1 time: 0.171424 Aug 26 08:53:00.341025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 61/135] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:00 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:00.736356 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8c95da68-7307-468e-8ab1-52a273489adf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:00.737222 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8c95da68-7307-468e-8ab1-52a273489adf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:00.745166 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c95da68-7307-468e-8ab1-52a273489adf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:00.745691 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c95da68-7307-468e-8ab1-52a273489adf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:00.746102 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c95da68-7307-468e-8ab1-52a273489adf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:00.746807 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c95da68-7307-468e-8ab1-52a273489adf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:00.747354 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c95da68-7307-468e-8ab1-52a273489adf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:00.747760 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c95da68-7307-468e-8ab1-52a273489adf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:00.888598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8c95da68-7307-468e-8ab1-52a273489adf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:00.897637 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8c95da68-7307-468e-8ab1-52a273489adf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.168334 Aug 26 08:53:00.898235 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 75/136] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:00 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:01.362711 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3f974c72-da62-4aac-b7f7-9da3d1365f47 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:01.363413 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3f974c72-da62-4aac-b7f7-9da3d1365f47 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:01.370846 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3f974c72-da62-4aac-b7f7-9da3d1365f47 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:01.371641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3f974c72-da62-4aac-b7f7-9da3d1365f47 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:01.372078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3f974c72-da62-4aac-b7f7-9da3d1365f47 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:01.372784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3f974c72-da62-4aac-b7f7-9da3d1365f47 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:01.373221 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3f974c72-da62-4aac-b7f7-9da3d1365f47 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:01.373933 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3f974c72-da62-4aac-b7f7-9da3d1365f47 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:01.514467 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3f974c72-da62-4aac-b7f7-9da3d1365f47 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:01.523847 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3f974c72-da62-4aac-b7f7-9da3d1365f47 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1553 microversion: 2.1 time: 0.166394 Aug 26 08:53:01.524681 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 62/137] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:01 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:01.878244 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1909923601", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "networks": [{"uuid": "dd23c74c-1e9d-4868-98c8-b6e82fab2a20"}]}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:01.920262 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-289a4607-4356-4c14-b72d-9743551fd592 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:01.921326 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-289a4607-4356-4c14-b72d-9743551fd592 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:01.931949 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-289a4607-4356-4c14-b72d-9743551fd592 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:01.931949 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-289a4607-4356-4c14-b72d-9743551fd592 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:01.931949 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-289a4607-4356-4c14-b72d-9743551fd592 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:01.931949 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-289a4607-4356-4c14-b72d-9743551fd592 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:01.932340 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-289a4607-4356-4c14-b72d-9743551fd592 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:01.932340 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-289a4607-4356-4c14-b72d-9743551fd592 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:01.946298 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.network.neutron [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] validate_networks() for [('dd23c74c-1e9d-4868-98c8-b6e82fab2a20', None, None, None, None, None)] {{(pid=132217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:53:02.108937 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-289a4607-4356-4c14-b72d-9743551fd592 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:02.118048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-289a4607-4356-4c14-b72d-9743551fd592 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.202337 Aug 26 08:53:02.131340 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 63/138] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:01 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:02.383069 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Flavor limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:53:02.383555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Image limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:53:02.384142 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Flavor pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:53:02.384596 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Image pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:53:02.385341 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:53:02.400000 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:02.400790 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:02.401299 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:02.402495 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:02.403202 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:02.403713 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:02.411198 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:02.434793 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Getting quotas for project 196b8882c5344c8380fecba536f39214. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:53:02.443502 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Getting quotas for user 230efbe75687494fa44777325c8acb4e and project 196b8882c5344c8380fecba536f39214. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:53:02.457074 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Going to run 1 instances... {{(pid=132217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:53:02.459426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:53:02.517271 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2f5b055a-e270-4222-9ede-bec42463075f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648838 Aug 26 08:53:02.518075 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 76/139] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:53:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 08:53:02.530389 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a5ee57c8-b0a9-4b46-b452-ef09b386e82e tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:02.531145 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a5ee57c8-b0a9-4b46-b452-ef09b386e82e tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:02.550344 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6c7ad1d0-2379-4125-8797-dfadf3ffd487 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:02.551061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6c7ad1d0-2379-4125-8797-dfadf3ffd487 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:02.564667 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c7ad1d0-2379-4125-8797-dfadf3ffd487 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:02.565561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c7ad1d0-2379-4125-8797-dfadf3ffd487 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:02.566173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c7ad1d0-2379-4125-8797-dfadf3ffd487 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:02.567042 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c7ad1d0-2379-4125-8797-dfadf3ffd487 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:02.567855 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c7ad1d0-2379-4125-8797-dfadf3ffd487 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:02.568623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c7ad1d0-2379-4125-8797-dfadf3ffd487 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:02.594182 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a5ee57c8-b0a9-4b46-b452-ef09b386e82e tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:02.603431 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a5ee57c8-b0a9-4b46-b452-ef09b386e82e tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1214 microversion: 2.1 time: 0.076896 Aug 26 08:53:02.605478 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 64/140] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:02 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:02.753736 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6c7ad1d0-2379-4125-8797-dfadf3ffd487 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:02.775386 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6c7ad1d0-2379-4125-8797-dfadf3ffd487 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1553 microversion: 2.1 time: 0.230986 Aug 26 08:53:02.775976 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 77/141] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:02 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1553 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:03.145937 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3016f37b-46b6-47fa-ab35-6c58a1b197bd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:03.148926 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3016f37b-46b6-47fa-ab35-6c58a1b197bd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:03.168966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3016f37b-46b6-47fa-ab35-6c58a1b197bd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:03.169488 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3016f37b-46b6-47fa-ab35-6c58a1b197bd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:03.169919 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3016f37b-46b6-47fa-ab35-6c58a1b197bd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:03.170712 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3016f37b-46b6-47fa-ab35-6c58a1b197bd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:03.173045 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3016f37b-46b6-47fa-ab35-6c58a1b197bd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:03.173554 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3016f37b-46b6-47fa-ab35-6c58a1b197bd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:03.333992 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3016f37b-46b6-47fa-ab35-6c58a1b197bd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:03.341943 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3016f37b-46b6-47fa-ab35-6c58a1b197bd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.205110 Aug 26 08:53:03.342550 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 65/142] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:03 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:03.639938 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f8ee08be-3490-4075-9648-eec32c1f168b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:03.640507 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f8ee08be-3490-4075-9648-eec32c1f168b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:03.647167 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f8ee08be-3490-4075-9648-eec32c1f168b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:03.647691 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f8ee08be-3490-4075-9648-eec32c1f168b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:03.648120 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f8ee08be-3490-4075-9648-eec32c1f168b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:03.648827 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f8ee08be-3490-4075-9648-eec32c1f168b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:03.649275 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f8ee08be-3490-4075-9648-eec32c1f168b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:03.649694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f8ee08be-3490-4075-9648-eec32c1f168b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:03.714492 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f8ee08be-3490-4075-9648-eec32c1f168b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:03.723703 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f8ee08be-3490-4075-9648-eec32c1f168b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1266 microversion: 2.1 time: 0.087565 Aug 26 08:53:03.724299 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 78/143] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:03 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:03.803198 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8a381848-e023-4d01-a8fd-dedef9d19e27 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:03.803948 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8a381848-e023-4d01-a8fd-dedef9d19e27 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:03.811367 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a381848-e023-4d01-a8fd-dedef9d19e27 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:03.811864 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a381848-e023-4d01-a8fd-dedef9d19e27 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:03.812345 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a381848-e023-4d01-a8fd-dedef9d19e27 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:03.813068 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a381848-e023-4d01-a8fd-dedef9d19e27 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:03.813633 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a381848-e023-4d01-a8fd-dedef9d19e27 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:03.813941 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a381848-e023-4d01-a8fd-dedef9d19e27 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:03.964422 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8a381848-e023-4d01-a8fd-dedef9d19e27 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:03.974581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8a381848-e023-4d01-a8fd-dedef9d19e27 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1553 microversion: 2.1 time: 0.180027 Aug 26 08:53:03.975313 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 66/144] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:03 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:04.366655 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8dc127c2-6977-413a-8e06-159f78cda91c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:04.367419 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8dc127c2-6977-413a-8e06-159f78cda91c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:04.381993 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8dc127c2-6977-413a-8e06-159f78cda91c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:04.382851 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8dc127c2-6977-413a-8e06-159f78cda91c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:04.391736 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8dc127c2-6977-413a-8e06-159f78cda91c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:04.393023 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8dc127c2-6977-413a-8e06-159f78cda91c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:04.393718 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8dc127c2-6977-413a-8e06-159f78cda91c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:04.394366 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8dc127c2-6977-413a-8e06-159f78cda91c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:04.625248 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-0fee88dc-e7ba-4770-a6ed-00d08ae6ee10 req-a7b27ff3-1c3d-421a-bcb1-0b212330e312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b14a44-0641-4121-9855-fe0454700263", "name": "network-vif-deleted", "tag": "e6c43102-4bd4-4b6b-8992-a1b7bca6db2b"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:04.651285 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-0fee88dc-e7ba-4770-a6ed-00d08ae6ee10 req-a7b27ff3-1c3d-421a-bcb1-0b212330e312 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:04.652303 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-0fee88dc-e7ba-4770-a6ed-00d08ae6ee10 req-a7b27ff3-1c3d-421a-bcb1-0b212330e312 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:04.653033 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-0fee88dc-e7ba-4770-a6ed-00d08ae6ee10 req-a7b27ff3-1c3d-421a-bcb1-0b212330e312 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:04.681834 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-0fee88dc-e7ba-4770-a6ed-00d08ae6ee10 req-a7b27ff3-1c3d-421a-bcb1-0b212330e312 service nova] Creating event network-vif-deleted:e6c43102-4bd4-4b6b-8992-a1b7bca6db2b for instance a0b14a44-0641-4121-9855-fe0454700263 on hv-cinder-85236 Aug 26 08:53:04.706280 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-0fee88dc-e7ba-4770-a6ed-00d08ae6ee10 req-a7b27ff3-1c3d-421a-bcb1-0b212330e312 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093429 Aug 26 08:53:04.707290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 67/145] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:53:04.762046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ecacf7de-43b6-4cd8-ab87-9787a8e1da8b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:04.763363 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ecacf7de-43b6-4cd8-ab87-9787a8e1da8b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:04.772666 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecacf7de-43b6-4cd8-ab87-9787a8e1da8b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:04.773427 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecacf7de-43b6-4cd8-ab87-9787a8e1da8b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:04.774314 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecacf7de-43b6-4cd8-ab87-9787a8e1da8b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:04.775318 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecacf7de-43b6-4cd8-ab87-9787a8e1da8b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:04.776009 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecacf7de-43b6-4cd8-ab87-9787a8e1da8b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:04.776627 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecacf7de-43b6-4cd8-ab87-9787a8e1da8b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:04.870788 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8dc127c2-6977-413a-8e06-159f78cda91c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:04.893145 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8dc127c2-6977-413a-8e06-159f78cda91c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.533298 Aug 26 08:53:04.894496 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 79/146] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:04 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:04.907288 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ecacf7de-43b6-4cd8-ab87-9787a8e1da8b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:04.917325 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ecacf7de-43b6-4cd8-ab87-9787a8e1da8b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1272 microversion: 2.1 time: 0.166487 Aug 26 08:53:04.917925 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 68/147] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:04 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:05.018371 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-5d1a437c-29a0-468b-aada-20c2dfe36ef9 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:05.019393 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-5d1a437c-29a0-468b-aada-20c2dfe36ef9 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:05.036209 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5d1a437c-29a0-468b-aada-20c2dfe36ef9 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:05.038684 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5d1a437c-29a0-468b-aada-20c2dfe36ef9 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:05.040518 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5d1a437c-29a0-468b-aada-20c2dfe36ef9 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:05.042459 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5d1a437c-29a0-468b-aada-20c2dfe36ef9 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:05.043897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5d1a437c-29a0-468b-aada-20c2dfe36ef9 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:05.045062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5d1a437c-29a0-468b-aada-20c2dfe36ef9 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:05.265068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-5d1a437c-29a0-468b-aada-20c2dfe36ef9 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:05.276715 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-5d1a437c-29a0-468b-aada-20c2dfe36ef9 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1345 microversion: 2.1 time: 0.281605 Aug 26 08:53:05.291201 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 80/148] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:04 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1345 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:05.925755 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0530eca0-f0ed-4cb3-b7d7-787f0465cc9a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:05.926631 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0530eca0-f0ed-4cb3-b7d7-787f0465cc9a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:05.943567 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3335f385-3b2a-4960-8cc5-94f683db348d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:05.944994 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3335f385-3b2a-4960-8cc5-94f683db348d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:05.946814 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0530eca0-f0ed-4cb3-b7d7-787f0465cc9a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:05.952197 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0530eca0-f0ed-4cb3-b7d7-787f0465cc9a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:05.953413 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0530eca0-f0ed-4cb3-b7d7-787f0465cc9a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:05.953931 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3335f385-3b2a-4960-8cc5-94f683db348d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:05.954707 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0530eca0-f0ed-4cb3-b7d7-787f0465cc9a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:05.954995 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3335f385-3b2a-4960-8cc5-94f683db348d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:05.955753 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3335f385-3b2a-4960-8cc5-94f683db348d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:05.956665 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0530eca0-f0ed-4cb3-b7d7-787f0465cc9a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:05.957189 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0530eca0-f0ed-4cb3-b7d7-787f0465cc9a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:05.957838 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3335f385-3b2a-4960-8cc5-94f683db348d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:05.959020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3335f385-3b2a-4960-8cc5-94f683db348d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:05.960112 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3335f385-3b2a-4960-8cc5-94f683db348d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:06.259551 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0530eca0-f0ed-4cb3-b7d7-787f0465cc9a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:06.277404 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0530eca0-f0ed-4cb3-b7d7-787f0465cc9a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.355565 Aug 26 08:53:06.278093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 69/149] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:05 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:06.303917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c8c3ac83-24a6-4bfa-a14d-0e28e6dbdd5c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:06.305661 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c8c3ac83-24a6-4bfa-a14d-0e28e6dbdd5c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:06.330410 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c8c3ac83-24a6-4bfa-a14d-0e28e6dbdd5c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:06.332974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c8c3ac83-24a6-4bfa-a14d-0e28e6dbdd5c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:06.333725 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c8c3ac83-24a6-4bfa-a14d-0e28e6dbdd5c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:06.334599 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c8c3ac83-24a6-4bfa-a14d-0e28e6dbdd5c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:06.335384 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c8c3ac83-24a6-4bfa-a14d-0e28e6dbdd5c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:06.335964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c8c3ac83-24a6-4bfa-a14d-0e28e6dbdd5c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:06.356785 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3335f385-3b2a-4960-8cc5-94f683db348d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:06.372802 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-3335f385-3b2a-4960-8cc5-94f683db348d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1314 microversion: 2.1 time: 0.434121 Aug 26 08:53:06.374168 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 81/150] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:05 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:06.421045 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c8c3ac83-24a6-4bfa-a14d-0e28e6dbdd5c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:06.421608 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c8c3ac83-24a6-4bfa-a14d-0e28e6dbdd5c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:06.422036 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c8c3ac83-24a6-4bfa-a14d-0e28e6dbdd5c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:06.422517 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-c8c3ac83-24a6-4bfa-a14d-0e28e6dbdd5c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lazy-loading 'fault' on Instance uuid a0b14a44-0641-4121-9855-fe0454700263 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:53:06.488088 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c8c3ac83-24a6-4bfa-a14d-0e28e6dbdd5c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd065c8a972df4b8e92996ce27e96b486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb70b9748b4ed69bfc098327cc1234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:06.503129 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c8c3ac83-24a6-4bfa-a14d-0e28e6dbdd5c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 200 len: 1304 microversion: 2.1 time: 0.206997 Aug 26 08:53:06.503904 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 70/151] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:06 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 1304 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:06.979040 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-7a72c986-1183-49a8-8c8c-5773af6bb791 req-a397e6be-b9b2-4f5d-8b59-8a38ab017a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26ca03c2-cba9-4202-9673-9235cfbb16a3", "tag": "11430b54-2c41-462a-add0-75e726267461"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:06.999291 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-7a72c986-1183-49a8-8c8c-5773af6bb791 req-a397e6be-b9b2-4f5d-8b59-8a38ab017a2f service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:07.002407 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-7a72c986-1183-49a8-8c8c-5773af6bb791 req-a397e6be-b9b2-4f5d-8b59-8a38ab017a2f service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:07.002863 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-7a72c986-1183-49a8-8c8c-5773af6bb791 req-a397e6be-b9b2-4f5d-8b59-8a38ab017a2f service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:07.023304 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-7a72c986-1183-49a8-8c8c-5773af6bb791 req-a397e6be-b9b2-4f5d-8b59-8a38ab017a2f service nova] Creating event network-changed:11430b54-2c41-462a-add0-75e726267461 for instance 26ca03c2-cba9-4202-9673-9235cfbb16a3 on hv-cinder-85236 Aug 26 08:53:07.031360 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-7a72c986-1183-49a8-8c8c-5773af6bb791 req-a397e6be-b9b2-4f5d-8b59-8a38ab017a2f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054792 Aug 26 08:53:07.032786 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 82/152] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:53:07.303248 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-afc749be-ba6e-4526-bf3e-5b81a18694a6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:07.303866 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-afc749be-ba6e-4526-bf3e-5b81a18694a6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:07.314464 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-afc749be-ba6e-4526-bf3e-5b81a18694a6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:07.315608 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-afc749be-ba6e-4526-bf3e-5b81a18694a6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:07.316312 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-afc749be-ba6e-4526-bf3e-5b81a18694a6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:07.317021 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-afc749be-ba6e-4526-bf3e-5b81a18694a6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:07.318002 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-afc749be-ba6e-4526-bf3e-5b81a18694a6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:07.318903 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-afc749be-ba6e-4526-bf3e-5b81a18694a6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:07.395744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b23d71fd-aa69-443d-909c-b7f7f57bf80d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:07.401691 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b23d71fd-aa69-443d-909c-b7f7f57bf80d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:07.417958 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b23d71fd-aa69-443d-909c-b7f7f57bf80d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:07.424135 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b23d71fd-aa69-443d-909c-b7f7f57bf80d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:07.424978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b23d71fd-aa69-443d-909c-b7f7f57bf80d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:07.426471 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b23d71fd-aa69-443d-909c-b7f7f57bf80d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:07.427152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b23d71fd-aa69-443d-909c-b7f7f57bf80d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:07.427796 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b23d71fd-aa69-443d-909c-b7f7f57bf80d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:07.546718 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-afc749be-ba6e-4526-bf3e-5b81a18694a6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:07.557257 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-afc749be-ba6e-4526-bf3e-5b81a18694a6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.261128 Aug 26 08:53:07.558296 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 71/153] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:07 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:07.563862 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-93b67bbc-21bc-4d53-b949-ffbe151b984c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:07.564714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-93b67bbc-21bc-4d53-b949-ffbe151b984c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:07.580296 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-93b67bbc-21bc-4d53-b949-ffbe151b984c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:07.580838 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-93b67bbc-21bc-4d53-b949-ffbe151b984c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:07.582057 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-93b67bbc-21bc-4d53-b949-ffbe151b984c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:07.583053 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-93b67bbc-21bc-4d53-b949-ffbe151b984c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:07.583982 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-93b67bbc-21bc-4d53-b949-ffbe151b984c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:07.584459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-93b67bbc-21bc-4d53-b949-ffbe151b984c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:07.612983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-93b67bbc-21bc-4d53-b949-ffbe151b984c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] HTTP exception thrown: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-93b67bbc-21bc-4d53-b949-ffbe151b984c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Request method failure captured: Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 HTTP/1.1 Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCIml_ol1KBTzDdbdwnSb9e0la7WKPZy_0BA_iPJIf_dZ2gAbn11B6pwVtiiYWQR8h2gWUWSkgOvGbTT95xhwxvNgQMvVFDuENQL9fyyo4mBj-0I3PuAFB8iqcD7lO36YqCJXPLHJOGW566suqj5-3AzBHug_rAft2SiLhIyCXk-wtdA Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 76bb70b9748b4ed69bfc098327cc1234 Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-DeleteServersTestJSON-551097629 Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 08:53:07.646811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 08:53:07.648357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_76bb70b9748b4ed69bfc098327cc1234", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/76bb70b9748b4ed69bfc098327cc1234"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/76bb70b9748b4ed69bfc098327cc1234"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/76bb70b9748b4ed69bfc098327cc1234"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:53:07.648357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-DeleteServersTestJSON-551097629 Aug 26 08:53:07.648357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 76bb70b9748b4ed69bfc098327cc1234 Aug 26 08:53:07.648357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-DeleteServersTestJSON-551097629 Aug 26 08:53:07.648357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-DeleteServersTestJSON-551097629-project Aug 26 08:53:07.648357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 08:53:07.648357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 08:53:07.648357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: d065c8a972df4b8e92996ce27e96b486 Aug 26 08:53:07.648357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-DeleteServersTestJSON-551097629-project Aug 26 08:53:07.648357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 08:53:07.648357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:07.648357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': 'a0b14a44-0641-4121-9855-fe0454700263'} Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:53:07.649207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:07.650576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:07.655459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-93b67bbc-21bc-4d53-b949-ffbe151b984c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Returning 404 to user: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:53:07.657545 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-93b67bbc-21bc-4d53-b949-ffbe151b984c tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 404 len: 111 microversion: 2.1 time: 0.097456 Aug 26 08:53:07.659414 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 72/154] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:07 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:53:07.850134 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b23d71fd-aa69-443d-909c-b7f7f57bf80d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:07.854281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c70f1f96-f9d7-4042-9fa2-2f913c295254 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:07.859250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c70f1f96-f9d7-4042-9fa2-2f913c295254 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:07.869984 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c70f1f96-f9d7-4042-9fa2-2f913c295254 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:07.870799 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c70f1f96-f9d7-4042-9fa2-2f913c295254 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:07.871616 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b23d71fd-aa69-443d-909c-b7f7f57bf80d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1314 microversion: 2.1 time: 0.479508 Aug 26 08:53:07.871778 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c70f1f96-f9d7-4042-9fa2-2f913c295254 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:07.873053 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c70f1f96-f9d7-4042-9fa2-2f913c295254 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:07.873660 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 83/155] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:07 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:07.873853 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c70f1f96-f9d7-4042-9fa2-2f913c295254 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:07.873853 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c70f1f96-f9d7-4042-9fa2-2f913c295254 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:07.890156 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-c70f1f96-f9d7-4042-9fa2-2f913c295254 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] HTTP exception thrown: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c70f1f96-f9d7-4042-9fa2-2f913c295254 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Request method failure captured: Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263/os-volume_attachments HTTP/1.1 Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCIml_ol1KBTzDdbdwnSb9e0la7WKPZy_0BA_iPJIf_dZ2gAbn11B6pwVtiiYWQR8h2gWUWSkgOvGbTT95xhwxvNgQMvVFDuENQL9fyyo4mBj-0I3PuAFB8iqcD7lO36YqCJXPLHJOGW566suqj5-3AzBHug_rAft2SiLhIyCXk-wtdA Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 76bb70b9748b4ed69bfc098327cc1234 Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-DeleteServersTestJSON-551097629 Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 08:53:07.892366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 08:53:07.895046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_76bb70b9748b4ed69bfc098327cc1234", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/76bb70b9748b4ed69bfc098327cc1234"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/76bb70b9748b4ed69bfc098327cc1234"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/76bb70b9748b4ed69bfc098327cc1234"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:53:07.895046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-DeleteServersTestJSON-551097629 Aug 26 08:53:07.895046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 76bb70b9748b4ed69bfc098327cc1234 Aug 26 08:53:07.895046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-DeleteServersTestJSON-551097629 Aug 26 08:53:07.895046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-DeleteServersTestJSON-551097629-project Aug 26 08:53:07.895046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 08:53:07.895046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 08:53:07.895046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: d065c8a972df4b8e92996ce27e96b486 Aug 26 08:53:07.895046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-DeleteServersTestJSON-551097629-project Aug 26 08:53:07.895046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 08:53:07.895046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:07.895046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'server_id': 'a0b14a44-0641-4121-9855-fe0454700263'} Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:53:07.896290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:07.898759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:07.901264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c70f1f96-f9d7-4042-9fa2-2f913c295254 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Returning 404 to user: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:53:07.901264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c70f1f96-f9d7-4042-9fa2-2f913c295254 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050316 Aug 26 08:53:07.901264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 73/156] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:53:07 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:53:08.581799 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f3592da5-3977-465f-ae86-7a01385e5fb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:08.582431 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f3592da5-3977-465f-ae86-7a01385e5fb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:08.588858 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f3592da5-3977-465f-ae86-7a01385e5fb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:08.589339 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f3592da5-3977-465f-ae86-7a01385e5fb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:08.589765 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f3592da5-3977-465f-ae86-7a01385e5fb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:08.590466 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f3592da5-3977-465f-ae86-7a01385e5fb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:08.591207 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f3592da5-3977-465f-ae86-7a01385e5fb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:08.591589 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f3592da5-3977-465f-ae86-7a01385e5fb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:08.751674 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f3592da5-3977-465f-ae86-7a01385e5fb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:08.767674 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f3592da5-3977-465f-ae86-7a01385e5fb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.190193 Aug 26 08:53:08.768393 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 84/157] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:08 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:08.895165 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-084e6dee-c7c2-4452-9fce-980906d1c74d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:08.896302 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-084e6dee-c7c2-4452-9fce-980906d1c74d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:08.903913 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-084e6dee-c7c2-4452-9fce-980906d1c74d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:08.904786 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-084e6dee-c7c2-4452-9fce-980906d1c74d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:08.905677 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-084e6dee-c7c2-4452-9fce-980906d1c74d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:08.906630 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-084e6dee-c7c2-4452-9fce-980906d1c74d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:08.907376 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-084e6dee-c7c2-4452-9fce-980906d1c74d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:08.908018 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-084e6dee-c7c2-4452-9fce-980906d1c74d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:09.100298 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-084e6dee-c7c2-4452-9fce-980906d1c74d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:09.111894 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-084e6dee-c7c2-4452-9fce-980906d1c74d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1314 microversion: 2.1 time: 0.221894 Aug 26 08:53:09.113206 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 74/158] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:08 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:09.167925 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-209613ee-8b0b-4c22-ab91-037ff240b202 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:09.168531 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-209613ee-8b0b-4c22-ab91-037ff240b202 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:09.175437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-209613ee-8b0b-4c22-ab91-037ff240b202 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:09.175902 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-209613ee-8b0b-4c22-ab91-037ff240b202 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:09.176195 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-209613ee-8b0b-4c22-ab91-037ff240b202 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:09.176954 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-209613ee-8b0b-4c22-ab91-037ff240b202 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:09.177329 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-209613ee-8b0b-4c22-ab91-037ff240b202 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:09.177742 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-209613ee-8b0b-4c22-ab91-037ff240b202 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:09.192465 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-209613ee-8b0b-4c22-ab91-037ff240b202 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] HTTP exception thrown: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-209613ee-8b0b-4c22-ab91-037ff240b202 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Request method failure captured: Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: DELETE /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 HTTP/1.1 Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIml_ol1KBTzDdbdwnSb9e0la7WKPZy_0BA_iPJIf_dZ2gAbn11B6pwVtiiYWQR8h2gWUWSkgOvGbTT95xhwxvNgQMvVFDuENQL9fyyo4mBj-0I3PuAFB8iqcD7lO36YqCJXPLHJOGW566suqj5-3AzBHug_rAft2SiLhIyCXk-wtdA Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 76bb70b9748b4ed69bfc098327cc1234 Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-DeleteServersTestJSON-551097629 Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 08:53:09.197494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 08:53:09.199019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_76bb70b9748b4ed69bfc098327cc1234", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/76bb70b9748b4ed69bfc098327cc1234"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/76bb70b9748b4ed69bfc098327cc1234"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/76bb70b9748b4ed69bfc098327cc1234"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:53:09.199019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-DeleteServersTestJSON-551097629 Aug 26 08:53:09.199019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 76bb70b9748b4ed69bfc098327cc1234 Aug 26 08:53:09.199019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-DeleteServersTestJSON-551097629 Aug 26 08:53:09.199019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-DeleteServersTestJSON-551097629-project Aug 26 08:53:09.199019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 08:53:09.199019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 08:53:09.199019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: d065c8a972df4b8e92996ce27e96b486 Aug 26 08:53:09.199019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-DeleteServersTestJSON-551097629-project Aug 26 08:53:09.199019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 08:53:09.199019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:09.199019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': 'a0b14a44-0641-4121-9855-fe0454700263'} Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:53:09.199893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:09.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:53:09.202630 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-209613ee-8b0b-4c22-ab91-037ff240b202 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Returning 404 to user: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:53:09.202630 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-209613ee-8b0b-4c22-ab91-037ff240b202 tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "DELETE /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 404 len: 111 microversion: 2.1 time: 0.035306 Aug 26 08:53:09.202630 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 85/159] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 08:53:09 2022] DELETE /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 08:53:09.209354 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9884c59e-39e1-4b0b-a620-0f72110a637d tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:09.210339 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9884c59e-39e1-4b0b-a620-0f72110a637d tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] [instance: a0b14a44-0641-4121-9855-fe0454700263] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:09.217282 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9884c59e-39e1-4b0b-a620-0f72110a637d tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:09.217912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9884c59e-39e1-4b0b-a620-0f72110a637d tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:09.218687 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9884c59e-39e1-4b0b-a620-0f72110a637d tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:09.219761 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9884c59e-39e1-4b0b-a620-0f72110a637d tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:09.220383 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9884c59e-39e1-4b0b-a620-0f72110a637d tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:09.220952 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9884c59e-39e1-4b0b-a620-0f72110a637d tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:09.224116 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=100 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:09.237485 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-9884c59e-39e1-4b0b-a620-0f72110a637d tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] HTTP exception thrown: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9884c59e-39e1-4b0b-a620-0f72110a637d tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Request method failure captured: Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 HTTP/1.1 Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCIml_ol1KBTzDdbdwnSb9e0la7WKPZy_0BA_iPJIf_dZ2gAbn11B6pwVtiiYWQR8h2gWUWSkgOvGbTT95xhwxvNgQMvVFDuENQL9fyyo4mBj-0I3PuAFB8iqcD7lO36YqCJXPLHJOGW566suqj5-3AzBHug_rAft2SiLhIyCXk-wtdA Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 76bb70b9748b4ed69bfc098327cc1234 Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-DeleteServersTestJSON-551097629 Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 08:53:09.239078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 08:53:09.240917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_76bb70b9748b4ed69bfc098327cc1234", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/76bb70b9748b4ed69bfc098327cc1234"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/76bb70b9748b4ed69bfc098327cc1234"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/76bb70b9748b4ed69bfc098327cc1234"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:53:09.240917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-DeleteServersTestJSON-551097629 Aug 26 08:53:09.240917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 76bb70b9748b4ed69bfc098327cc1234 Aug 26 08:53:09.240917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-DeleteServersTestJSON-551097629 Aug 26 08:53:09.240917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-DeleteServersTestJSON-551097629-project Aug 26 08:53:09.240917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 08:53:09.240917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 08:53:09.240917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: d065c8a972df4b8e92996ce27e96b486 Aug 26 08:53:09.240917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-DeleteServersTestJSON-551097629-project Aug 26 08:53:09.240917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 08:53:09.240917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:09.240917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': 'a0b14a44-0641-4121-9855-fe0454700263'} Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:53:09.242511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. Aug 26 08:53:09.246324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:09.249059 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9884c59e-39e1-4b0b-a620-0f72110a637d tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] Returning 404 to user: Instance a0b14a44-0641-4121-9855-fe0454700263 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:53:09.249059 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9884c59e-39e1-4b0b-a620-0f72110a637d tempest-DeleteServersTestJSON-551097629 tempest-DeleteServersTestJSON-551097629-project] 10.222.0.71 "GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263" status: 404 len: 111 microversion: 2.1 time: 0.035707 Aug 26 08:53:09.249059 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 75/160] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:09 2022] GET /compute/v2.1/servers/a0b14a44-0641-4121-9855-fe0454700263 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:53:09.802766 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-016e3d14-a5dc-480a-b870-5c75e3c89db8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:09.803421 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-016e3d14-a5dc-480a-b870-5c75e3c89db8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:09.821831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-016e3d14-a5dc-480a-b870-5c75e3c89db8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:09.822716 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-016e3d14-a5dc-480a-b870-5c75e3c89db8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:09.823289 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-016e3d14-a5dc-480a-b870-5c75e3c89db8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:09.824084 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-016e3d14-a5dc-480a-b870-5c75e3c89db8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:09.824627 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-016e3d14-a5dc-480a-b870-5c75e3c89db8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:09.825077 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-016e3d14-a5dc-480a-b870-5c75e3c89db8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:10.031996 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-016e3d14-a5dc-480a-b870-5c75e3c89db8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:10.053724 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-016e3d14-a5dc-480a-b870-5c75e3c89db8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.254481 Aug 26 08:53:10.056255 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 86/161] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:09 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:10.139090 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f853ce22-d05b-4cef-b9a4-658f5dbe4323 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:10.140221 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f853ce22-d05b-4cef-b9a4-658f5dbe4323 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:10.158778 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f853ce22-d05b-4cef-b9a4-658f5dbe4323 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:10.160062 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f853ce22-d05b-4cef-b9a4-658f5dbe4323 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:10.160980 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f853ce22-d05b-4cef-b9a4-658f5dbe4323 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:10.162227 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f853ce22-d05b-4cef-b9a4-658f5dbe4323 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:10.163031 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f853ce22-d05b-4cef-b9a4-658f5dbe4323 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:10.163889 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f853ce22-d05b-4cef-b9a4-658f5dbe4323 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:10.518010 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f853ce22-d05b-4cef-b9a4-658f5dbe4323 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:10.528209 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f853ce22-d05b-4cef-b9a4-658f5dbe4323 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1314 microversion: 2.1 time: 0.396161 Aug 26 08:53:10.528816 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 76/162] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:10 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:11.083895 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e8e130b7-e1cf-42ae-9d29-7d28aa2e3857 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:11.084780 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e8e130b7-e1cf-42ae-9d29-7d28aa2e3857 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:11.095493 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e8e130b7-e1cf-42ae-9d29-7d28aa2e3857 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:11.097983 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e8e130b7-e1cf-42ae-9d29-7d28aa2e3857 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:11.098748 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e8e130b7-e1cf-42ae-9d29-7d28aa2e3857 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:11.100455 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e8e130b7-e1cf-42ae-9d29-7d28aa2e3857 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:11.100965 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e8e130b7-e1cf-42ae-9d29-7d28aa2e3857 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:11.101470 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e8e130b7-e1cf-42ae-9d29-7d28aa2e3857 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:11.342237 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e8e130b7-e1cf-42ae-9d29-7d28aa2e3857 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:11.350975 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e8e130b7-e1cf-42ae-9d29-7d28aa2e3857 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.274095 Aug 26 08:53:11.351985 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 87/163] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:11 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:11.554465 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-68ab3413-b196-4cda-b963-450f0edca4c8 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:11.555405 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-68ab3413-b196-4cda-b963-450f0edca4c8 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:11.562240 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-68ab3413-b196-4cda-b963-450f0edca4c8 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:11.562738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-68ab3413-b196-4cda-b963-450f0edca4c8 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:11.563205 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-68ab3413-b196-4cda-b963-450f0edca4c8 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:11.564397 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-68ab3413-b196-4cda-b963-450f0edca4c8 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:11.565043 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-68ab3413-b196-4cda-b963-450f0edca4c8 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:11.565713 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-68ab3413-b196-4cda-b963-450f0edca4c8 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:11.814426 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-68ab3413-b196-4cda-b963-450f0edca4c8 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:11.831728 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-68ab3413-b196-4cda-b963-450f0edca4c8 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1314 microversion: 2.1 time: 0.280814 Aug 26 08:53:11.832601 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 77/164] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:11 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:12.391329 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3ce98f4d-d3c6-48e6-81ab-49b9be482419 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:12.393348 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3ce98f4d-d3c6-48e6-81ab-49b9be482419 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:12.417756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:12.441868 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ce98f4d-d3c6-48e6-81ab-49b9be482419 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:12.442749 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ce98f4d-d3c6-48e6-81ab-49b9be482419 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:12.450689 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ce98f4d-d3c6-48e6-81ab-49b9be482419 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:12.454380 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ce98f4d-d3c6-48e6-81ab-49b9be482419 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:12.462233 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ce98f4d-d3c6-48e6-81ab-49b9be482419 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:12.463178 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ce98f4d-d3c6-48e6-81ab-49b9be482419 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:12.465204 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=6 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:12.480051 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-700dc3a2-7b7a-40dd-9a67-4cb93b2cc22a req-f91f1cdc-313e-4607-81c3-31ec0351d104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ca03c2-cba9-4202-9673-9235cfbb16a3", "name": "network-vif-plugged", "status": "completed", "tag": "11430b54-2c41-462a-add0-75e726267461"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:12.553072 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-700dc3a2-7b7a-40dd-9a67-4cb93b2cc22a req-f91f1cdc-313e-4607-81c3-31ec0351d104 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:12.553928 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-700dc3a2-7b7a-40dd-9a67-4cb93b2cc22a req-f91f1cdc-313e-4607-81c3-31ec0351d104 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:12.556899 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-700dc3a2-7b7a-40dd-9a67-4cb93b2cc22a req-f91f1cdc-313e-4607-81c3-31ec0351d104 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:12.587027 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-700dc3a2-7b7a-40dd-9a67-4cb93b2cc22a req-f91f1cdc-313e-4607-81c3-31ec0351d104 service nova] Creating event network-vif-plugged:11430b54-2c41-462a-add0-75e726267461 for instance 26ca03c2-cba9-4202-9673-9235cfbb16a3 on hv-cinder-85236 Aug 26 08:53:12.598855 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-700dc3a2-7b7a-40dd-9a67-4cb93b2cc22a req-f91f1cdc-313e-4607-81c3-31ec0351d104 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125548 Aug 26 08:53:12.608378 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 78/165] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:53:12.852612 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:12.860766 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8b459136-f5a5-44df-888c-c1c628d26d65 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:12.862262 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8b459136-f5a5-44df-888c-c1c628d26d65 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:12.876455 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8b459136-f5a5-44df-888c-c1c628d26d65 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:12.877362 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8b459136-f5a5-44df-888c-c1c628d26d65 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:12.877968 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8b459136-f5a5-44df-888c-c1c628d26d65 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:12.878869 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8b459136-f5a5-44df-888c-c1c628d26d65 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:12.879522 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8b459136-f5a5-44df-888c-c1c628d26d65 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:12.880098 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8b459136-f5a5-44df-888c-c1c628d26d65 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:13.124488 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8b459136-f5a5-44df-888c-c1c628d26d65 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:13.137039 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8b459136-f5a5-44df-888c-c1c628d26d65 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1314 microversion: 2.1 time: 0.285957 Aug 26 08:53:13.137900 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 79/166] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:12 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:13.289603 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3ce98f4d-d3c6-48e6-81ab-49b9be482419 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:13.319596 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-3ce98f4d-d3c6-48e6-81ab-49b9be482419 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.936769 Aug 26 08:53:13.321109 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 88/167] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:12 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:14.170103 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6ca4e249-8fc8-4ef6-8ecf-dd393f9cec2d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:14.172576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6ca4e249-8fc8-4ef6-8ecf-dd393f9cec2d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:14.188790 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6ca4e249-8fc8-4ef6-8ecf-dd393f9cec2d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:14.189919 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6ca4e249-8fc8-4ef6-8ecf-dd393f9cec2d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:14.190615 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6ca4e249-8fc8-4ef6-8ecf-dd393f9cec2d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:14.191628 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6ca4e249-8fc8-4ef6-8ecf-dd393f9cec2d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:14.192282 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6ca4e249-8fc8-4ef6-8ecf-dd393f9cec2d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:14.193074 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6ca4e249-8fc8-4ef6-8ecf-dd393f9cec2d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:14.356294 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2cdc5765-2570-4598-a8b8-bb4c7cf71763 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:14.359257 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2cdc5765-2570-4598-a8b8-bb4c7cf71763 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:14.391561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2cdc5765-2570-4598-a8b8-bb4c7cf71763 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:14.394402 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2cdc5765-2570-4598-a8b8-bb4c7cf71763 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:14.396333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2cdc5765-2570-4598-a8b8-bb4c7cf71763 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:14.413190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2cdc5765-2570-4598-a8b8-bb4c7cf71763 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:14.413773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2cdc5765-2570-4598-a8b8-bb4c7cf71763 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:14.414225 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2cdc5765-2570-4598-a8b8-bb4c7cf71763 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:14.625197 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6ca4e249-8fc8-4ef6-8ecf-dd393f9cec2d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:14.637137 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6ca4e249-8fc8-4ef6-8ecf-dd393f9cec2d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1314 microversion: 2.1 time: 0.473442 Aug 26 08:53:14.638390 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 80/168] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:14 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:14.927865 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2cdc5765-2570-4598-a8b8-bb4c7cf71763 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:14.942852 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2cdc5765-2570-4598-a8b8-bb4c7cf71763 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.595473 Aug 26 08:53:14.944029 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 89/169] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:14 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:15.693260 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-350023d9-2806-4145-8fee-152f1afd1895 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:15.695537 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-350023d9-2806-4145-8fee-152f1afd1895 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:15.706511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=64 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:15.719383 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-350023d9-2806-4145-8fee-152f1afd1895 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:15.732346 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-350023d9-2806-4145-8fee-152f1afd1895 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:15.733678 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-350023d9-2806-4145-8fee-152f1afd1895 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:15.735255 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-350023d9-2806-4145-8fee-152f1afd1895 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:15.738210 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-350023d9-2806-4145-8fee-152f1afd1895 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:15.739131 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-350023d9-2806-4145-8fee-152f1afd1895 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:15.971798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-853a00f8-6ed1-4abd-9467-80fe2557ca40 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:15.974279 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-853a00f8-6ed1-4abd-9467-80fe2557ca40 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:15.985624 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-853a00f8-6ed1-4abd-9467-80fe2557ca40 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:15.986542 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-853a00f8-6ed1-4abd-9467-80fe2557ca40 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:15.988221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-853a00f8-6ed1-4abd-9467-80fe2557ca40 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:15.990262 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-853a00f8-6ed1-4abd-9467-80fe2557ca40 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:15.991810 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-853a00f8-6ed1-4abd-9467-80fe2557ca40 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:15.992923 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-853a00f8-6ed1-4abd-9467-80fe2557ca40 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:16.086558 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-350023d9-2806-4145-8fee-152f1afd1895 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:16.106123 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-350023d9-2806-4145-8fee-152f1afd1895 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1314 microversion: 2.1 time: 0.422978 Aug 26 08:53:16.108799 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 81/170] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:15 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:16.246198 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-853a00f8-6ed1-4abd-9467-80fe2557ca40 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:16.256731 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-853a00f8-6ed1-4abd-9467-80fe2557ca40 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.292356 Aug 26 08:53:16.257559 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 90/171] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:15 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:17.140250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-cd6477fb-26f7-4974-8bd5-badac6987937 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:17.141128 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-cd6477fb-26f7-4974-8bd5-badac6987937 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:17.150158 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd6477fb-26f7-4974-8bd5-badac6987937 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:17.151002 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd6477fb-26f7-4974-8bd5-badac6987937 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:17.151510 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd6477fb-26f7-4974-8bd5-badac6987937 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:17.152854 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd6477fb-26f7-4974-8bd5-badac6987937 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:17.153656 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd6477fb-26f7-4974-8bd5-badac6987937 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:17.154386 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd6477fb-26f7-4974-8bd5-badac6987937 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:17.282219 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-42ddc978-79a8-4479-97f5-de33eecd09b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:17.283135 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-42ddc978-79a8-4479-97f5-de33eecd09b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:17.293481 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-42ddc978-79a8-4479-97f5-de33eecd09b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:17.294259 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-42ddc978-79a8-4479-97f5-de33eecd09b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:17.295234 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-42ddc978-79a8-4479-97f5-de33eecd09b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:17.296522 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-42ddc978-79a8-4479-97f5-de33eecd09b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:17.297388 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-42ddc978-79a8-4479-97f5-de33eecd09b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:17.298348 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-42ddc978-79a8-4479-97f5-de33eecd09b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:17.345090 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-cd6477fb-26f7-4974-8bd5-badac6987937 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:17.358134 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-cd6477fb-26f7-4974-8bd5-badac6987937 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1314 microversion: 2.1 time: 0.221894 Aug 26 08:53:17.359246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 82/172] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:17 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:17.778854 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-42ddc978-79a8-4479-97f5-de33eecd09b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:17.793357 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-42ddc978-79a8-4479-97f5-de33eecd09b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.514919 Aug 26 08:53:17.794159 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 91/173] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:17 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:18.386106 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-434a3eaa-e154-43f3-8603-0592fd9ed1cc tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:18.387073 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-434a3eaa-e154-43f3-8603-0592fd9ed1cc tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:18.396598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-434a3eaa-e154-43f3-8603-0592fd9ed1cc tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:18.397614 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-434a3eaa-e154-43f3-8603-0592fd9ed1cc tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:18.398420 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-434a3eaa-e154-43f3-8603-0592fd9ed1cc tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:18.399313 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-434a3eaa-e154-43f3-8603-0592fd9ed1cc tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:18.399937 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-434a3eaa-e154-43f3-8603-0592fd9ed1cc tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:18.400460 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-434a3eaa-e154-43f3-8603-0592fd9ed1cc tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:18.602725 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-434a3eaa-e154-43f3-8603-0592fd9ed1cc tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:18.620975 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-434a3eaa-e154-43f3-8603-0592fd9ed1cc tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1314 microversion: 2.1 time: 0.240229 Aug 26 08:53:18.623172 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 83/174] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:18 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:18.834314 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c5f05bdb-6a07-4e1b-ab7f-e6c431337698 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:18.841542 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c5f05bdb-6a07-4e1b-ab7f-e6c431337698 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:18.856470 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c5f05bdb-6a07-4e1b-ab7f-e6c431337698 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:18.856966 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c5f05bdb-6a07-4e1b-ab7f-e6c431337698 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:18.857397 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c5f05bdb-6a07-4e1b-ab7f-e6c431337698 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:18.858416 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c5f05bdb-6a07-4e1b-ab7f-e6c431337698 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:18.859234 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c5f05bdb-6a07-4e1b-ab7f-e6c431337698 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:18.859980 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c5f05bdb-6a07-4e1b-ab7f-e6c431337698 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:19.208435 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c5f05bdb-6a07-4e1b-ab7f-e6c431337698 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:19.218666 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c5f05bdb-6a07-4e1b-ab7f-e6c431337698 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.396355 Aug 26 08:53:19.219567 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 92/175] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:18 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:19.657682 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-18f9dc31-a98f-4c1d-a2c1-0fffaba08d88 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:19.658691 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-18f9dc31-a98f-4c1d-a2c1-0fffaba08d88 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:19.682834 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-18f9dc31-a98f-4c1d-a2c1-0fffaba08d88 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:19.684576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-18f9dc31-a98f-4c1d-a2c1-0fffaba08d88 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:19.685315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-18f9dc31-a98f-4c1d-a2c1-0fffaba08d88 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:19.686598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-18f9dc31-a98f-4c1d-a2c1-0fffaba08d88 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:19.687208 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-18f9dc31-a98f-4c1d-a2c1-0fffaba08d88 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:19.687646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-18f9dc31-a98f-4c1d-a2c1-0fffaba08d88 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:20.036620 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-18f9dc31-a98f-4c1d-a2c1-0fffaba08d88 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:20.064986 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-18f9dc31-a98f-4c1d-a2c1-0fffaba08d88 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1497 microversion: 2.1 time: 0.413905 Aug 26 08:53:20.083720 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 84/176] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:19 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1497 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:20.244198 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-37e9a05a-5d7a-4ac1-ae3b-e5bd3f538b02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:20.246374 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-37e9a05a-5d7a-4ac1-ae3b-e5bd3f538b02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:20.285024 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37e9a05a-5d7a-4ac1-ae3b-e5bd3f538b02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:20.285764 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37e9a05a-5d7a-4ac1-ae3b-e5bd3f538b02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:20.286434 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37e9a05a-5d7a-4ac1-ae3b-e5bd3f538b02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:20.288955 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37e9a05a-5d7a-4ac1-ae3b-e5bd3f538b02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:20.290974 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37e9a05a-5d7a-4ac1-ae3b-e5bd3f538b02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:20.293025 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37e9a05a-5d7a-4ac1-ae3b-e5bd3f538b02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:20.684140 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-37e9a05a-5d7a-4ac1-ae3b-e5bd3f538b02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:20.697683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-37e9a05a-5d7a-4ac1-ae3b-e5bd3f538b02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.459577 Aug 26 08:53:20.700210 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 93/177] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:20 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:20.915633 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-745267eb-7cea-4f53-afa2-20e0b6e290e1 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:20.916269 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-745267eb-7cea-4f53-afa2-20e0b6e290e1 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:20.955435 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-745267eb-7cea-4f53-afa2-20e0b6e290e1 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:20.963034 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-745267eb-7cea-4f53-afa2-20e0b6e290e1 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:20.964168 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-745267eb-7cea-4f53-afa2-20e0b6e290e1 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:20.965305 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-745267eb-7cea-4f53-afa2-20e0b6e290e1 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:20.966131 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-745267eb-7cea-4f53-afa2-20e0b6e290e1 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:20.967054 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-745267eb-7cea-4f53-afa2-20e0b6e290e1 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:21.010751 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-745267eb-7cea-4f53-afa2-20e0b6e290e1 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 08:53:21.138469 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-745267eb-7cea-4f53-afa2-20e0b6e290e1 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "DELETE /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 204 len: 0 microversion: 2.1 time: 0.228633 Aug 26 08:53:21.141159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 85/178] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 08:53:20 2022] DELETE /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:53:21.156971 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-32467314-d7cf-4b9a-97ad-1384d06f2cfb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:21.157859 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-32467314-d7cf-4b9a-97ad-1384d06f2cfb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:21.167010 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-32467314-d7cf-4b9a-97ad-1384d06f2cfb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:21.168166 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-32467314-d7cf-4b9a-97ad-1384d06f2cfb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:21.168616 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-32467314-d7cf-4b9a-97ad-1384d06f2cfb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:21.169386 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-32467314-d7cf-4b9a-97ad-1384d06f2cfb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:21.170093 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-32467314-d7cf-4b9a-97ad-1384d06f2cfb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:21.170608 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-32467314-d7cf-4b9a-97ad-1384d06f2cfb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:21.500144 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-32467314-d7cf-4b9a-97ad-1384d06f2cfb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:21.504757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=100 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:21.522294 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-32467314-d7cf-4b9a-97ad-1384d06f2cfb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1503 microversion: 2.1 time: 0.371292 Aug 26 08:53:21.523115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 94/179] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:21 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1503 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:21.728025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0f4f567a-92b7-48d2-90d6-b9a2d7cb9883 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:21.744032 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0f4f567a-92b7-48d2-90d6-b9a2d7cb9883 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:21.756241 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f4f567a-92b7-48d2-90d6-b9a2d7cb9883 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:21.757199 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f4f567a-92b7-48d2-90d6-b9a2d7cb9883 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:21.758579 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f4f567a-92b7-48d2-90d6-b9a2d7cb9883 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:21.759423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f4f567a-92b7-48d2-90d6-b9a2d7cb9883 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:21.760008 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f4f567a-92b7-48d2-90d6-b9a2d7cb9883 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:21.760451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f4f567a-92b7-48d2-90d6-b9a2d7cb9883 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:22.085826 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0f4f567a-92b7-48d2-90d6-b9a2d7cb9883 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:22.104716 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0f4f567a-92b7-48d2-90d6-b9a2d7cb9883 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.382488 Aug 26 08:53:22.105683 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 86/180] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:21 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:22.566983 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2495e134-2c1c-4b1c-a217-78f15ba8facd tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:22.569369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2495e134-2c1c-4b1c-a217-78f15ba8facd tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:22.588886 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2495e134-2c1c-4b1c-a217-78f15ba8facd tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:22.591449 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2495e134-2c1c-4b1c-a217-78f15ba8facd tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:22.603139 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2495e134-2c1c-4b1c-a217-78f15ba8facd tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:22.604176 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2495e134-2c1c-4b1c-a217-78f15ba8facd tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:22.605057 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2495e134-2c1c-4b1c-a217-78f15ba8facd tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:22.605804 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2495e134-2c1c-4b1c-a217-78f15ba8facd tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:22.881037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2495e134-2c1c-4b1c-a217-78f15ba8facd tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:22.894335 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2495e134-2c1c-4b1c-a217-78f15ba8facd tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1503 microversion: 2.1 time: 0.337412 Aug 26 08:53:22.894335 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 95/181] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:22 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1503 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:23.134840 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0653ce0c-c539-4940-b84a-ae6decc93cb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:23.135669 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0653ce0c-c539-4940-b84a-ae6decc93cb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:23.145808 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0653ce0c-c539-4940-b84a-ae6decc93cb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:23.146859 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0653ce0c-c539-4940-b84a-ae6decc93cb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:23.147926 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0653ce0c-c539-4940-b84a-ae6decc93cb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:23.148981 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0653ce0c-c539-4940-b84a-ae6decc93cb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:23.149698 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0653ce0c-c539-4940-b84a-ae6decc93cb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:23.150537 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0653ce0c-c539-4940-b84a-ae6decc93cb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:23.734442 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0653ce0c-c539-4940-b84a-ae6decc93cb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:23.745632 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0653ce0c-c539-4940-b84a-ae6decc93cb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.616218 Aug 26 08:53:23.747123 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 87/182] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:23 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:23.926860 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-965931e1-6b9a-4b39-83a5-5b2e74166f06 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:23.927794 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-965931e1-6b9a-4b39-83a5-5b2e74166f06 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:23.930504 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:23.935167 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-965931e1-6b9a-4b39-83a5-5b2e74166f06 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:23.935694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-965931e1-6b9a-4b39-83a5-5b2e74166f06 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:23.936189 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-965931e1-6b9a-4b39-83a5-5b2e74166f06 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:23.936916 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-965931e1-6b9a-4b39-83a5-5b2e74166f06 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:23.937362 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-965931e1-6b9a-4b39-83a5-5b2e74166f06 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:23.937897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-965931e1-6b9a-4b39-83a5-5b2e74166f06 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:24.140375 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-965931e1-6b9a-4b39-83a5-5b2e74166f06 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:24.153128 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-965931e1-6b9a-4b39-83a5-5b2e74166f06 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1503 microversion: 2.1 time: 0.230484 Aug 26 08:53:24.154359 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 96/183] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:23 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:24.769783 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3b740dcf-4898-4186-80ad-114f64c34c95 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Action: 'create', calling method: .version_select at 0x7f136c1aaf70>, body: {"keypair": {"name": "tempest-keypair-1241427218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEPa6aJ59kmphPMZkRo9hSapp+rNDHLJ765uuyYRzfrVpIFwj0q9mrz2y70kUPMsvtlnDGFAJwwLTNW17A0Fm34H8COryhXshAmWV0mPaC/nHof39lR2UhsDKAssD825g=="}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:24.777085 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-734b1fa3-f487-453c-a0ab-f1147fa97f0c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:24.778166 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-734b1fa3-f487-453c-a0ab-f1147fa97f0c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:24.786791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-734b1fa3-f487-453c-a0ab-f1147fa97f0c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:24.787798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-734b1fa3-f487-453c-a0ab-f1147fa97f0c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:24.788814 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-734b1fa3-f487-453c-a0ab-f1147fa97f0c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:24.789207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-3b740dcf-4898-4186-80ad-114f64c34c95 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'key_pairs'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:53:24.790481 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-734b1fa3-f487-453c-a0ab-f1147fa97f0c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:24.791567 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-734b1fa3-f487-453c-a0ab-f1147fa97f0c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:24.792340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-734b1fa3-f487-453c-a0ab-f1147fa97f0c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:24.794124 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-3b740dcf-4898-4186-80ad-114f64c34c95 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for user 406be06d6adf40bbb48d9baf12022988 and project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'key_pairs'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:53:24.831323 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3b740dcf-4898-4186-80ad-114f64c34c95 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.249087 Aug 26 08:53:24.839723 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 88/184] 10.222.0.71 () {60 vars in 1159 bytes} [Fri Aug 26 08:53:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:53:24.978785 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-734b1fa3-f487-453c-a0ab-f1147fa97f0c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:24.988686 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-734b1fa3-f487-453c-a0ab-f1147fa97f0c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.218636 Aug 26 08:53:24.989300 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 97/185] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:24 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:25.179527 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d29f9d1b-fc9d-4f02-89e4-b1a93716c7ac tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:25.180146 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d29f9d1b-fc9d-4f02-89e4-b1a93716c7ac tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:25.192211 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d29f9d1b-fc9d-4f02-89e4-b1a93716c7ac tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:25.193075 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d29f9d1b-fc9d-4f02-89e4-b1a93716c7ac tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:25.193837 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d29f9d1b-fc9d-4f02-89e4-b1a93716c7ac tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:25.195112 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d29f9d1b-fc9d-4f02-89e4-b1a93716c7ac tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:25.195955 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d29f9d1b-fc9d-4f02-89e4-b1a93716c7ac tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:25.196778 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d29f9d1b-fc9d-4f02-89e4-b1a93716c7ac tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:25.446708 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d29f9d1b-fc9d-4f02-89e4-b1a93716c7ac tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:25.456336 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d29f9d1b-fc9d-4f02-89e4-b1a93716c7ac tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1503 microversion: 2.1 time: 0.281740 Aug 26 08:53:25.474762 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 89/186] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:25 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1503 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:26.016439 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-683d876d-c439-4f9a-9ea3-9bc4d73c496f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:26.017419 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-683d876d-c439-4f9a-9ea3-9bc4d73c496f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:26.028909 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-683d876d-c439-4f9a-9ea3-9bc4d73c496f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:26.029651 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-683d876d-c439-4f9a-9ea3-9bc4d73c496f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:26.030513 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-683d876d-c439-4f9a-9ea3-9bc4d73c496f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:26.031879 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-683d876d-c439-4f9a-9ea3-9bc4d73c496f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:26.032771 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-683d876d-c439-4f9a-9ea3-9bc4d73c496f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:26.033604 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-683d876d-c439-4f9a-9ea3-9bc4d73c496f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:26.242996 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-683d876d-c439-4f9a-9ea3-9bc4d73c496f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:26.255093 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-683d876d-c439-4f9a-9ea3-9bc4d73c496f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.246222 Aug 26 08:53:26.256123 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 98/187] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:26 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:26.480681 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5e98c958-a6ea-4fd4-ad84-142ad73afc45 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:26.481495 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5e98c958-a6ea-4fd4-ad84-142ad73afc45 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:26.492049 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5e98c958-a6ea-4fd4-ad84-142ad73afc45 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:26.493316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5e98c958-a6ea-4fd4-ad84-142ad73afc45 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:26.494292 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5e98c958-a6ea-4fd4-ad84-142ad73afc45 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:26.495820 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5e98c958-a6ea-4fd4-ad84-142ad73afc45 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:26.496568 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5e98c958-a6ea-4fd4-ad84-142ad73afc45 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:26.497118 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5e98c958-a6ea-4fd4-ad84-142ad73afc45 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:26.728905 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5e98c958-a6ea-4fd4-ad84-142ad73afc45 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:26.742307 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5e98c958-a6ea-4fd4-ad84-142ad73afc45 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1503 microversion: 2.1 time: 0.266864 Aug 26 08:53:26.742999 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 90/188] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:26 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1503 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:27.280079 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1011921509", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e1c5bc8-bb18-4879-912d-f9e237efa42e"}], "security_groups": [{"name": "tempest-securitygroup--740061499"}], "key_name": "tempest-keypair-1241427218", "user_data": "}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:27.290824 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e51a1b0a-cc3a-4637-8210-2f5c7bbae69a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:27.291377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e51a1b0a-cc3a-4637-8210-2f5c7bbae69a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:27.301235 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e51a1b0a-cc3a-4637-8210-2f5c7bbae69a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:27.301998 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e51a1b0a-cc3a-4637-8210-2f5c7bbae69a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:27.302706 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e51a1b0a-cc3a-4637-8210-2f5c7bbae69a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:27.303721 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e51a1b0a-cc3a-4637-8210-2f5c7bbae69a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:27.304342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e51a1b0a-cc3a-4637-8210-2f5c7bbae69a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:27.304969 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e51a1b0a-cc3a-4637-8210-2f5c7bbae69a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:27.554770 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e51a1b0a-cc3a-4637-8210-2f5c7bbae69a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:27.619722 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e51a1b0a-cc3a-4637-8210-2f5c7bbae69a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.345446 Aug 26 08:53:27.620663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 91/189] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:27 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:27.626935 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-8ad5dce3-ef6a-4d15-9c5e-8bbac69c9ea4 req-6daccd62-cc7b-4dac-a15e-238e34d2ece4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ca03c2-cba9-4202-9673-9235cfbb16a3", "name": "network-vif-deleted", "tag": "11430b54-2c41-462a-add0-75e726267461"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:27.635469 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.network.neutron [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] validate_networks() for [('4e1c5bc8-bb18-4879-912d-f9e237efa42e', None, None, None, None, None)] {{(pid=132217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:53:27.659005 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-8ad5dce3-ef6a-4d15-9c5e-8bbac69c9ea4 req-6daccd62-cc7b-4dac-a15e-238e34d2ece4 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:27.660146 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-8ad5dce3-ef6a-4d15-9c5e-8bbac69c9ea4 req-6daccd62-cc7b-4dac-a15e-238e34d2ece4 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:27.661398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-8ad5dce3-ef6a-4d15-9c5e-8bbac69c9ea4 req-6daccd62-cc7b-4dac-a15e-238e34d2ece4 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:27.692656 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-8ad5dce3-ef6a-4d15-9c5e-8bbac69c9ea4 req-6daccd62-cc7b-4dac-a15e-238e34d2ece4 service nova] Creating event network-vif-deleted:11430b54-2c41-462a-add0-75e726267461 for instance 26ca03c2-cba9-4202-9673-9235cfbb16a3 on hv-cinder-85236 Aug 26 08:53:27.702556 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-8ad5dce3-ef6a-4d15-9c5e-8bbac69c9ea4 req-6daccd62-cc7b-4dac-a15e-238e34d2ece4 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079332 Aug 26 08:53:27.704017 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 92/190] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:53:27.788104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-500dc48e-3b81-441c-95e6-8c3d0d6b40c2 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:27.789398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-500dc48e-3b81-441c-95e6-8c3d0d6b40c2 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:27.798940 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-500dc48e-3b81-441c-95e6-8c3d0d6b40c2 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:27.799926 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-500dc48e-3b81-441c-95e6-8c3d0d6b40c2 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:27.800556 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-500dc48e-3b81-441c-95e6-8c3d0d6b40c2 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:27.801737 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-500dc48e-3b81-441c-95e6-8c3d0d6b40c2 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:27.802587 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-500dc48e-3b81-441c-95e6-8c3d0d6b40c2 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:27.803448 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-500dc48e-3b81-441c-95e6-8c3d0d6b40c2 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:27.809688 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:27.862846 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-500dc48e-3b81-441c-95e6-8c3d0d6b40c2 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:27.863404 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-500dc48e-3b81-441c-95e6-8c3d0d6b40c2 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:27.864022 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-500dc48e-3b81-441c-95e6-8c3d0d6b40c2 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:27.864783 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-500dc48e-3b81-441c-95e6-8c3d0d6b40c2 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lazy-loading 'fault' on Instance uuid 26ca03c2-cba9-4202-9673-9235cfbb16a3 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:53:27.939434 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-500dc48e-3b81-441c-95e6-8c3d0d6b40c2 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:27.953115 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-500dc48e-3b81-441c-95e6-8c3d0d6b40c2 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 200 len: 1304 microversion: 2.1 time: 0.188980 Aug 26 08:53:27.955155 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 93/191] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:27 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 1304 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:28.404671 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Flavor limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:53:28.406030 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Image limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:53:28.406623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Flavor pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:53:28.407088 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Image pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:53:28.407504 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:53:28.423620 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:28.423993 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:28.425023 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:28.426549 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:28.427531 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:28.428124 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:28.474982 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:53:28.486164 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for user 406be06d6adf40bbb48d9baf12022988 and project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:53:28.522433 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Going to run 1 instances... {{(pid=132217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:53:28.536160 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:53:28.632895 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4d65ed78-95b8-4771-b50f-5dda12bd4c6f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.357103 Aug 26 08:53:28.635169 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 99/192] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:53:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 08:53:28.659653 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b7023e19-0218-49a9-a75d-8ccb0cdb6df4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:28.663191 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b7023e19-0218-49a9-a75d-8ccb0cdb6df4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:28.689654 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-be7bab00-de3d-4f7f-a4f5-4525f31a90d0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:28.691307 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-be7bab00-de3d-4f7f-a4f5-4525f31a90d0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:28.717126 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-be7bab00-de3d-4f7f-a4f5-4525f31a90d0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:28.719873 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-be7bab00-de3d-4f7f-a4f5-4525f31a90d0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:28.721123 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-be7bab00-de3d-4f7f-a4f5-4525f31a90d0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:28.723174 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-be7bab00-de3d-4f7f-a4f5-4525f31a90d0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:28.724746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-be7bab00-de3d-4f7f-a4f5-4525f31a90d0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:28.725916 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-be7bab00-de3d-4f7f-a4f5-4525f31a90d0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:28.806564 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b7023e19-0218-49a9-a75d-8ccb0cdb6df4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:28.822577 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b7023e19-0218-49a9-a75d-8ccb0cdb6df4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1242 microversion: 2.1 time: 0.176050 Aug 26 08:53:28.838482 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 94/193] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:28 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1242 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:28.992860 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6297cfe0-8346-4819-80a4-b049cf48964b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:28.993689 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6297cfe0-8346-4819-80a4-b049cf48964b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 26ca03c2-cba9-4202-9673-9235cfbb16a3] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:29.012443 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6297cfe0-8346-4819-80a4-b049cf48964b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:29.013639 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6297cfe0-8346-4819-80a4-b049cf48964b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:29.015111 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6297cfe0-8346-4819-80a4-b049cf48964b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:29.017080 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6297cfe0-8346-4819-80a4-b049cf48964b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:29.019128 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6297cfe0-8346-4819-80a4-b049cf48964b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:29.019387 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6297cfe0-8346-4819-80a4-b049cf48964b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:29.067856 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-be7bab00-de3d-4f7f-a4f5-4525f31a90d0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:29.073748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-6297cfe0-8346-4819-80a4-b049cf48964b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] HTTP exception thrown: Instance 26ca03c2-cba9-4202-9673-9235cfbb16a3 could not be found. Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6297cfe0-8346-4819-80a4-b049cf48964b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Request method failure captured: Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 HTTP/1.1 Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCInoso5AbVbcRplx90E7u7ghl33VnT3yrElmXU1j0N-vk5tctdTXSY5qnMwibrCQA19AOYVZqts-UqJeLneWyLvQtyR1QXemKw-IfT-_UJy-JqAt5WzEkCs4bwJjZzC8b23Rwl0CyeyW_CXXZpNnZwylXGOrn4A0OzSkAtbIVm7QinM Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 196b8882c5344c8380fecba536f39214 Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-VolumesActionsTest-1201923513 Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 08:53:29.085058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 08:53:29.087365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_196b8882c5344c8380fecba536f39214", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/196b8882c5344c8380fecba536f39214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/196b8882c5344c8380fecba536f39214"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/196b8882c5344c8380fecba536f39214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:53:29.087365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-VolumesActionsTest-1201923513 Aug 26 08:53:29.087365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 196b8882c5344c8380fecba536f39214 Aug 26 08:53:29.087365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-VolumesActionsTest-1201923513 Aug 26 08:53:29.087365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-VolumesActionsTest-1201923513-project Aug 26 08:53:29.087365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 08:53:29.087365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 08:53:29.087365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 230efbe75687494fa44777325c8acb4e Aug 26 08:53:29.087365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-VolumesActionsTest-1201923513-project Aug 26 08:53:29.087365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 08:53:29.087365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance 26ca03c2-cba9-4202-9673-9235cfbb16a3 could not be found. Aug 26 08:53:29.087365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': '26ca03c2-cba9-4202-9673-9235cfbb16a3'} Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26ca03c2-cba9-4202-9673-9235cfbb16a3 could not be found. Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:53:29.088740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26ca03c2-cba9-4202-9673-9235cfbb16a3 could not be found. Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26ca03c2-cba9-4202-9673-9235cfbb16a3 could not be found. Aug 26 08:53:29.089823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:53:29.090777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6297cfe0-8346-4819-80a4-b049cf48964b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Returning 404 to user: Instance 26ca03c2-cba9-4202-9673-9235cfbb16a3 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:53:29.090777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6297cfe0-8346-4819-80a4-b049cf48964b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3" status: 404 len: 111 microversion: 2.1 time: 0.101617 Aug 26 08:53:29.090947 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-be7bab00-de3d-4f7f-a4f5-4525f31a90d0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.438670 Aug 26 08:53:29.107123 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 100/194] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:28 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:29.113064 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 95/195] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:28 2022] GET /compute/v2.1/servers/26ca03c2-cba9-4202-9673-9235cfbb16a3 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:53:29.312174 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-84401642", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "networks": [{"uuid": "dd23c74c-1e9d-4868-98c8-b6e82fab2a20"}]}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:29.416305 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.network.neutron [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] validate_networks() for [('dd23c74c-1e9d-4868-98c8-b6e82fab2a20', None, None, None, None, None)] {{(pid=132217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:53:29.851178 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6881013c-9acb-44bd-a3d1-b9375312a91f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:29.852151 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6881013c-9acb-44bd-a3d1-b9375312a91f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:29.863861 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6881013c-9acb-44bd-a3d1-b9375312a91f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:29.864504 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6881013c-9acb-44bd-a3d1-b9375312a91f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:29.865313 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6881013c-9acb-44bd-a3d1-b9375312a91f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:29.866579 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6881013c-9acb-44bd-a3d1-b9375312a91f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:29.867643 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6881013c-9acb-44bd-a3d1-b9375312a91f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:29.868420 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6881013c-9acb-44bd-a3d1-b9375312a91f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:29.966673 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6881013c-9acb-44bd-a3d1-b9375312a91f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:29.983122 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6881013c-9acb-44bd-a3d1-b9375312a91f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1238 microversion: 2.1 time: 0.140415 Aug 26 08:53:29.984828 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 96/196] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:29 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1238 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:30.095985 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Flavor limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:53:30.096678 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Image limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:53:30.097489 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Flavor pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:53:30.098182 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Image pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:53:30.098753 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:53:30.110229 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:30.111057 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:30.111673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:30.113623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:30.114107 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:30.114595 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:30.142976 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7e1287e8-9f3c-4fcd-a195-03b3659639a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:30.143764 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Getting quotas for project 196b8882c5344c8380fecba536f39214. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:53:30.144497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-7e1287e8-9f3c-4fcd-a195-03b3659639a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:30.152651 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Getting quotas for user 230efbe75687494fa44777325c8acb4e and project 196b8882c5344c8380fecba536f39214. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:53:30.160274 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7e1287e8-9f3c-4fcd-a195-03b3659639a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:30.161655 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7e1287e8-9f3c-4fcd-a195-03b3659639a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:30.163638 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7e1287e8-9f3c-4fcd-a195-03b3659639a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:30.165644 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7e1287e8-9f3c-4fcd-a195-03b3659639a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:30.166262 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7e1287e8-9f3c-4fcd-a195-03b3659639a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:30.167641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7e1287e8-9f3c-4fcd-a195-03b3659639a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:30.180976 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Going to run 1 instances... {{(pid=132217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:53:30.184978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:53:30.281676 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d9741d21-f189-4a88-8d39-3d67c10c16a6 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974675 Aug 26 08:53:30.283659 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 101/197] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:53:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 08:53:30.331198 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-614c70d7-e82f-4d49-a732-c8dd275b3bfa tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:30.332488 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-614c70d7-e82f-4d49-a732-c8dd275b3bfa tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:30.453893 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-7e1287e8-9f3c-4fcd-a195-03b3659639a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:30.466000 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7e1287e8-9f3c-4fcd-a195-03b3659639a9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.338505 Aug 26 08:53:30.466998 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 97/198] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:30 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:30.485223 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-614c70d7-e82f-4d49-a732-c8dd275b3bfa tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:30.501266 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-614c70d7-e82f-4d49-a732-c8dd275b3bfa tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1212 microversion: 2.1 time: 0.207570 Aug 26 08:53:30.502949 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 102/199] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:30 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1212 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:31.018844 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4f275927-71a4-4b9e-8861-3442f595e3ce tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:31.020038 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4f275927-71a4-4b9e-8861-3442f595e3ce tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:31.035964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f275927-71a4-4b9e-8861-3442f595e3ce tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:31.036622 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f275927-71a4-4b9e-8861-3442f595e3ce tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:31.037261 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f275927-71a4-4b9e-8861-3442f595e3ce tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:31.038010 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f275927-71a4-4b9e-8861-3442f595e3ce tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:31.038782 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f275927-71a4-4b9e-8861-3442f595e3ce tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:31.039537 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f275927-71a4-4b9e-8861-3442f595e3ce tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:31.159166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4f275927-71a4-4b9e-8861-3442f595e3ce tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:31.180162 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4f275927-71a4-4b9e-8861-3442f595e3ce tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1302 microversion: 2.1 time: 0.169382 Aug 26 08:53:31.184253 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 98/200] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:31 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1302 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:31.496072 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6a460073-b11a-4e8f-a749-9f6a8ad688b8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:31.496868 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6a460073-b11a-4e8f-a749-9f6a8ad688b8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:31.506123 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6a460073-b11a-4e8f-a749-9f6a8ad688b8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:31.507326 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6a460073-b11a-4e8f-a749-9f6a8ad688b8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:31.508375 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6a460073-b11a-4e8f-a749-9f6a8ad688b8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:31.509438 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6a460073-b11a-4e8f-a749-9f6a8ad688b8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:31.510170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6a460073-b11a-4e8f-a749-9f6a8ad688b8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:31.510853 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6a460073-b11a-4e8f-a749-9f6a8ad688b8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:31.533518 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3fde0d7e-14b4-49e0-b1e2-fadb7efb9df7 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:31.534558 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3fde0d7e-14b4-49e0-b1e2-fadb7efb9df7 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:31.548262 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3fde0d7e-14b4-49e0-b1e2-fadb7efb9df7 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:31.550382 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3fde0d7e-14b4-49e0-b1e2-fadb7efb9df7 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:31.551777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3fde0d7e-14b4-49e0-b1e2-fadb7efb9df7 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:31.553666 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3fde0d7e-14b4-49e0-b1e2-fadb7efb9df7 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:31.555500 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3fde0d7e-14b4-49e0-b1e2-fadb7efb9df7 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:31.556454 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3fde0d7e-14b4-49e0-b1e2-fadb7efb9df7 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:31.673985 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3fde0d7e-14b4-49e0-b1e2-fadb7efb9df7 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:31.683205 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3fde0d7e-14b4-49e0-b1e2-fadb7efb9df7 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1264 microversion: 2.1 time: 0.161712 Aug 26 08:53:31.684497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 99/201] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:31 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:31.899959 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6a460073-b11a-4e8f-a749-9f6a8ad688b8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:31.914140 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6a460073-b11a-4e8f-a749-9f6a8ad688b8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.422246 Aug 26 08:53:31.914958 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 103/202] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:31 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:32.222391 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1ba74f0d-b98e-4f3e-bed8-92069cce2129 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:32.223334 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1ba74f0d-b98e-4f3e-bed8-92069cce2129 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:32.248119 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1ba74f0d-b98e-4f3e-bed8-92069cce2129 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:32.248716 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1ba74f0d-b98e-4f3e-bed8-92069cce2129 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:32.249161 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1ba74f0d-b98e-4f3e-bed8-92069cce2129 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:32.249917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1ba74f0d-b98e-4f3e-bed8-92069cce2129 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:32.250363 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1ba74f0d-b98e-4f3e-bed8-92069cce2129 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:32.250779 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1ba74f0d-b98e-4f3e-bed8-92069cce2129 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:32.347763 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1ba74f0d-b98e-4f3e-bed8-92069cce2129 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:32.360110 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1ba74f0d-b98e-4f3e-bed8-92069cce2129 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1300 microversion: 2.1 time: 0.142683 Aug 26 08:53:32.384976 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 100/203] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:32 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1300 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:32.726215 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ba804c6d-e1f7-426a-9a47-623b7391bb43 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:32.727537 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ba804c6d-e1f7-426a-9a47-623b7391bb43 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:32.737814 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba804c6d-e1f7-426a-9a47-623b7391bb43 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:32.738746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba804c6d-e1f7-426a-9a47-623b7391bb43 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:32.739590 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba804c6d-e1f7-426a-9a47-623b7391bb43 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:32.740598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba804c6d-e1f7-426a-9a47-623b7391bb43 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:32.741442 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba804c6d-e1f7-426a-9a47-623b7391bb43 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:32.742574 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba804c6d-e1f7-426a-9a47-623b7391bb43 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:32.823898 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ba804c6d-e1f7-426a-9a47-623b7391bb43 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:32.839512 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ba804c6d-e1f7-426a-9a47-623b7391bb43 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1282 microversion: 2.1 time: 0.117481 Aug 26 08:53:32.839512 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 104/204] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:32 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:32.945372 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d6f0cb4b-879a-443f-b731-5e152a7cb76b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:32.946331 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d6f0cb4b-879a-443f-b731-5e152a7cb76b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:32.969763 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d6f0cb4b-879a-443f-b731-5e152a7cb76b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:32.970304 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d6f0cb4b-879a-443f-b731-5e152a7cb76b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:32.972250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d6f0cb4b-879a-443f-b731-5e152a7cb76b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:32.973452 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d6f0cb4b-879a-443f-b731-5e152a7cb76b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:32.974143 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d6f0cb4b-879a-443f-b731-5e152a7cb76b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:32.974759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d6f0cb4b-879a-443f-b731-5e152a7cb76b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:33.403271 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-7f7b2b07-0b08-4f9f-adb8-7bc4981d4e46 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:33.404501 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-7f7b2b07-0b08-4f9f-adb8-7bc4981d4e46 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:33.423675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7f7b2b07-0b08-4f9f-adb8-7bc4981d4e46 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:33.424725 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7f7b2b07-0b08-4f9f-adb8-7bc4981d4e46 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:33.430274 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7f7b2b07-0b08-4f9f-adb8-7bc4981d4e46 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:33.431593 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7f7b2b07-0b08-4f9f-adb8-7bc4981d4e46 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:33.432427 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7f7b2b07-0b08-4f9f-adb8-7bc4981d4e46 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:33.433194 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7f7b2b07-0b08-4f9f-adb8-7bc4981d4e46 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:33.764865 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d6f0cb4b-879a-443f-b731-5e152a7cb76b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:33.786860 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d6f0cb4b-879a-443f-b731-5e152a7cb76b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.848796 Aug 26 08:53:33.809339 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 101/205] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:32 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:33.858444 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f0676bec-c602-4dc7-aec2-65146bd97d97 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:33.859796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f0676bec-c602-4dc7-aec2-65146bd97d97 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:33.869884 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0676bec-c602-4dc7-aec2-65146bd97d97 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:33.871372 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0676bec-c602-4dc7-aec2-65146bd97d97 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:33.872755 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0676bec-c602-4dc7-aec2-65146bd97d97 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:33.874315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0676bec-c602-4dc7-aec2-65146bd97d97 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:33.875204 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0676bec-c602-4dc7-aec2-65146bd97d97 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:33.876203 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0676bec-c602-4dc7-aec2-65146bd97d97 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:34.071193 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f0676bec-c602-4dc7-aec2-65146bd97d97 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:34.081589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f0676bec-c602-4dc7-aec2-65146bd97d97 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1270 microversion: 2.1 time: 0.228295 Aug 26 08:53:34.083315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 102/206] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:33 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1270 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:34.122510 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7f7b2b07-0b08-4f9f-adb8-7bc4981d4e46 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:34.135501 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-7f7b2b07-0b08-4f9f-adb8-7bc4981d4e46 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1367 microversion: 2.1 time: 0.747594 Aug 26 08:53:34.157007 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 105/207] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:33 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1367 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:34.785057 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-5f2c38ba-23c6-48b7-ad26-5378b1c34be1 req-ca9b0e26-296e-4619-b870-4066aee96d4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e441bb-c7f1-4f57-a936-ae82ddea56c5", "tag": "577f1e58-da5c-4628-a0bd-bcf24fc8842e"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:34.811382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d53d0c17-16eb-4ddd-b7a9-03f8afd6dd6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:34.812393 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d53d0c17-16eb-4ddd-b7a9-03f8afd6dd6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:34.819805 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-5f2c38ba-23c6-48b7-ad26-5378b1c34be1 req-ca9b0e26-296e-4619-b870-4066aee96d4d service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:34.823165 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-5f2c38ba-23c6-48b7-ad26-5378b1c34be1 req-ca9b0e26-296e-4619-b870-4066aee96d4d service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:34.825426 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-5f2c38ba-23c6-48b7-ad26-5378b1c34be1 req-ca9b0e26-296e-4619-b870-4066aee96d4d service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:34.833069 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d53d0c17-16eb-4ddd-b7a9-03f8afd6dd6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:34.836797 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d53d0c17-16eb-4ddd-b7a9-03f8afd6dd6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:34.842154 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d53d0c17-16eb-4ddd-b7a9-03f8afd6dd6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:34.843951 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d53d0c17-16eb-4ddd-b7a9-03f8afd6dd6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:34.845316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d53d0c17-16eb-4ddd-b7a9-03f8afd6dd6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:34.846098 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d53d0c17-16eb-4ddd-b7a9-03f8afd6dd6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:34.858032 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-5f2c38ba-23c6-48b7-ad26-5378b1c34be1 req-ca9b0e26-296e-4619-b870-4066aee96d4d service nova] Creating event network-changed:577f1e58-da5c-4628-a0bd-bcf24fc8842e for instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 on hv-cinder-85236 Aug 26 08:53:34.885908 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-5f2c38ba-23c6-48b7-ad26-5378b1c34be1 req-ca9b0e26-296e-4619-b870-4066aee96d4d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104575 Aug 26 08:53:34.886751 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 103/208] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:53:35.116250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-28f7c9e4-ce92-4b46-87c1-a9a0f135b15d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:35.117891 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-28f7c9e4-ce92-4b46-87c1-a9a0f135b15d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:35.129718 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-28f7c9e4-ce92-4b46-87c1-a9a0f135b15d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:35.130595 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-28f7c9e4-ce92-4b46-87c1-a9a0f135b15d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:35.131426 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-28f7c9e4-ce92-4b46-87c1-a9a0f135b15d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:35.132958 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-28f7c9e4-ce92-4b46-87c1-a9a0f135b15d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:35.133891 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-28f7c9e4-ce92-4b46-87c1-a9a0f135b15d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:35.134674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-28f7c9e4-ce92-4b46-87c1-a9a0f135b15d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:35.322594 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d53d0c17-16eb-4ddd-b7a9-03f8afd6dd6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:35.340917 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d53d0c17-16eb-4ddd-b7a9-03f8afd6dd6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.534198 Aug 26 08:53:35.342482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 106/209] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:34 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:35.348169 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-59318de2-d998-459d-9b1b-94c34d8c8f05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:35.349215 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-59318de2-d998-459d-9b1b-94c34d8c8f05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:35.378307 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-59318de2-d998-459d-9b1b-94c34d8c8f05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:35.378817 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-59318de2-d998-459d-9b1b-94c34d8c8f05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:35.379276 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-59318de2-d998-459d-9b1b-94c34d8c8f05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:35.380208 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-59318de2-d998-459d-9b1b-94c34d8c8f05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:35.380897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-59318de2-d998-459d-9b1b-94c34d8c8f05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:35.381452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-59318de2-d998-459d-9b1b-94c34d8c8f05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:35.546726 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-28f7c9e4-ce92-4b46-87c1-a9a0f135b15d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:35.566292 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-28f7c9e4-ce92-4b46-87c1-a9a0f135b15d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1312 microversion: 2.1 time: 0.458860 Aug 26 08:53:35.568327 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 104/210] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:35 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1312 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:35.716666 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-92dcd0b9-8336-4c95-9ad6-ff7a03b207d5 req-047fa846-7328-4ad2-b39d-4b5b276f6780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8b7b79-29d0-4a40-9f13-94198c5d2fbd", "tag": "71e6d342-8d25-44d8-99eb-50fd5e431bc4"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:35.728264 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-59318de2-d998-459d-9b1b-94c34d8c8f05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:35.746076 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-59318de2-d998-459d-9b1b-94c34d8c8f05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1367 microversion: 2.1 time: 0.402158 Aug 26 08:53:35.747468 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 107/211] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:35 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:35.748155 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-92dcd0b9-8336-4c95-9ad6-ff7a03b207d5 req-047fa846-7328-4ad2-b39d-4b5b276f6780 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:35.749385 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-92dcd0b9-8336-4c95-9ad6-ff7a03b207d5 req-047fa846-7328-4ad2-b39d-4b5b276f6780 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:35.750019 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-92dcd0b9-8336-4c95-9ad6-ff7a03b207d5 req-047fa846-7328-4ad2-b39d-4b5b276f6780 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:35.764994 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-92dcd0b9-8336-4c95-9ad6-ff7a03b207d5 req-047fa846-7328-4ad2-b39d-4b5b276f6780 service nova] Creating event network-changed:71e6d342-8d25-44d8-99eb-50fd5e431bc4 for instance 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd on hv-cinder-85236 Aug 26 08:53:35.770542 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-92dcd0b9-8336-4c95-9ad6-ff7a03b207d5 req-047fa846-7328-4ad2-b39d-4b5b276f6780 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069938 Aug 26 08:53:35.772345 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 105/212] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:53:36.382769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2da3155d-94b7-4162-9f06-970b4d05c0e2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:36.384008 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2da3155d-94b7-4162-9f06-970b4d05c0e2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:36.391425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2da3155d-94b7-4162-9f06-970b4d05c0e2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:36.392209 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2da3155d-94b7-4162-9f06-970b4d05c0e2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:36.392878 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2da3155d-94b7-4162-9f06-970b4d05c0e2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:36.393763 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2da3155d-94b7-4162-9f06-970b4d05c0e2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:36.394358 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2da3155d-94b7-4162-9f06-970b4d05c0e2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:36.394941 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2da3155d-94b7-4162-9f06-970b4d05c0e2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:36.581033 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2da3155d-94b7-4162-9f06-970b4d05c0e2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:36.592740 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2da3155d-94b7-4162-9f06-970b4d05c0e2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.216767 Aug 26 08:53:36.594116 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 108/213] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:36 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:36.606483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-21f7a96c-459f-436e-b6c9-34c65311b93a tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:36.608179 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-21f7a96c-459f-436e-b6c9-34c65311b93a tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:36.617279 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-21f7a96c-459f-436e-b6c9-34c65311b93a tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:36.618022 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-21f7a96c-459f-436e-b6c9-34c65311b93a tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:36.618456 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-21f7a96c-459f-436e-b6c9-34c65311b93a tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:36.619396 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-21f7a96c-459f-436e-b6c9-34c65311b93a tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:36.619846 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-21f7a96c-459f-436e-b6c9-34c65311b93a tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:36.620255 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-21f7a96c-459f-436e-b6c9-34c65311b93a tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:36.775334 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-01ed747b-da49-444b-8c0d-4062507a2311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:36.776056 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-01ed747b-da49-444b-8c0d-4062507a2311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:36.783456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01ed747b-da49-444b-8c0d-4062507a2311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:36.784471 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01ed747b-da49-444b-8c0d-4062507a2311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:36.788573 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-21f7a96c-459f-436e-b6c9-34c65311b93a tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:36.793516 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01ed747b-da49-444b-8c0d-4062507a2311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:36.794584 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01ed747b-da49-444b-8c0d-4062507a2311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:36.795239 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01ed747b-da49-444b-8c0d-4062507a2311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:36.795997 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01ed747b-da49-444b-8c0d-4062507a2311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:36.799155 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-21f7a96c-459f-436e-b6c9-34c65311b93a tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1312 microversion: 2.1 time: 0.208884 Aug 26 08:53:36.801777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 106/214] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:36 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1312 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:37.034832 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-01ed747b-da49-444b-8c0d-4062507a2311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:37.053255 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-01ed747b-da49-444b-8c0d-4062507a2311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1367 microversion: 2.1 time: 0.281929 Aug 26 08:53:37.068007 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 109/215] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:36 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:37.617348 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1f428469-d260-4cd4-8b64-0720e2207ed7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:37.618759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1f428469-d260-4cd4-8b64-0720e2207ed7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:37.626959 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1f428469-d260-4cd4-8b64-0720e2207ed7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:37.627827 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1f428469-d260-4cd4-8b64-0720e2207ed7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:37.628358 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1f428469-d260-4cd4-8b64-0720e2207ed7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:37.629095 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1f428469-d260-4cd4-8b64-0720e2207ed7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:37.633719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1f428469-d260-4cd4-8b64-0720e2207ed7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:37.633719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1f428469-d260-4cd4-8b64-0720e2207ed7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:37.798316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1f428469-d260-4cd4-8b64-0720e2207ed7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:37.810848 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1f428469-d260-4cd4-8b64-0720e2207ed7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.198897 Aug 26 08:53:37.811600 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 107/216] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:37 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:37.825913 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-62e87b69-69db-4537-b617-d02d9c400cfa tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:37.826520 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-62e87b69-69db-4537-b617-d02d9c400cfa tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:37.833141 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-62e87b69-69db-4537-b617-d02d9c400cfa tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:37.833657 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-62e87b69-69db-4537-b617-d02d9c400cfa tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:37.834076 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-62e87b69-69db-4537-b617-d02d9c400cfa tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:37.834772 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-62e87b69-69db-4537-b617-d02d9c400cfa tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:37.835332 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-62e87b69-69db-4537-b617-d02d9c400cfa tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:37.835743 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-62e87b69-69db-4537-b617-d02d9c400cfa tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:38.072129 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-62e87b69-69db-4537-b617-d02d9c400cfa tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:38.077173 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-db62558b-e81c-4ca2-bc79-f6aa62ce3142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:38.078063 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-db62558b-e81c-4ca2-bc79-f6aa62ce3142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:38.080243 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-62e87b69-69db-4537-b617-d02d9c400cfa tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1312 microversion: 2.1 time: 0.260426 Aug 26 08:53:38.088673 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-db62558b-e81c-4ca2-bc79-f6aa62ce3142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:38.089539 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-db62558b-e81c-4ca2-bc79-f6aa62ce3142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:38.095554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 110/217] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:37 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1312 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:38.095959 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-db62558b-e81c-4ca2-bc79-f6aa62ce3142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:38.097361 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-db62558b-e81c-4ca2-bc79-f6aa62ce3142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:38.098030 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-db62558b-e81c-4ca2-bc79-f6aa62ce3142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:38.098611 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-db62558b-e81c-4ca2-bc79-f6aa62ce3142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:38.284435 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-db62558b-e81c-4ca2-bc79-f6aa62ce3142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:38.293368 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-db62558b-e81c-4ca2-bc79-f6aa62ce3142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1367 microversion: 2.1 time: 0.221211 Aug 26 08:53:38.293988 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 108/218] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:38 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:38.836923 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-99521e55-3d01-4cbc-b2a3-db24479cbcd1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:38.837534 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-99521e55-3d01-4cbc-b2a3-db24479cbcd1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:38.844560 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-99521e55-3d01-4cbc-b2a3-db24479cbcd1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:38.845050 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-99521e55-3d01-4cbc-b2a3-db24479cbcd1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:38.845482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-99521e55-3d01-4cbc-b2a3-db24479cbcd1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:38.846220 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-99521e55-3d01-4cbc-b2a3-db24479cbcd1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:38.846739 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-99521e55-3d01-4cbc-b2a3-db24479cbcd1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:38.847126 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-99521e55-3d01-4cbc-b2a3-db24479cbcd1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:39.004541 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-99521e55-3d01-4cbc-b2a3-db24479cbcd1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:39.013420 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-99521e55-3d01-4cbc-b2a3-db24479cbcd1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.181065 Aug 26 08:53:39.014005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 111/219] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:38 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:39.104566 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ba78ef45-d14a-43a3-ac27-2960a1cc08bf tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:39.105721 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ba78ef45-d14a-43a3-ac27-2960a1cc08bf tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:39.108274 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=6 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:39.114561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba78ef45-d14a-43a3-ac27-2960a1cc08bf tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:39.115087 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba78ef45-d14a-43a3-ac27-2960a1cc08bf tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:39.115523 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba78ef45-d14a-43a3-ac27-2960a1cc08bf tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:39.116284 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba78ef45-d14a-43a3-ac27-2960a1cc08bf tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:39.116675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba78ef45-d14a-43a3-ac27-2960a1cc08bf tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:39.117745 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba78ef45-d14a-43a3-ac27-2960a1cc08bf tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:39.269212 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ba78ef45-d14a-43a3-ac27-2960a1cc08bf tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:39.280933 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ba78ef45-d14a-43a3-ac27-2960a1cc08bf tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1312 microversion: 2.1 time: 0.180500 Aug 26 08:53:39.281869 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 109/220] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:39 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:39.324211 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-399277b5-6f12-4149-9bb1-4130a733d14a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:39.324746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-399277b5-6f12-4149-9bb1-4130a733d14a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:39.331402 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-399277b5-6f12-4149-9bb1-4130a733d14a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:39.331884 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-399277b5-6f12-4149-9bb1-4130a733d14a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:39.332309 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-399277b5-6f12-4149-9bb1-4130a733d14a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:39.333191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-399277b5-6f12-4149-9bb1-4130a733d14a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:39.333562 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-399277b5-6f12-4149-9bb1-4130a733d14a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:39.334056 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-399277b5-6f12-4149-9bb1-4130a733d14a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:39.495331 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-399277b5-6f12-4149-9bb1-4130a733d14a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:39.504207 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-399277b5-6f12-4149-9bb1-4130a733d14a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1367 microversion: 2.1 time: 0.183935 Aug 26 08:53:39.505415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 112/221] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:39 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:40.038571 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ecb9ec85-6579-48fb-8af9-059c4088c590 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:40.039167 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ecb9ec85-6579-48fb-8af9-059c4088c590 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:40.047109 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecb9ec85-6579-48fb-8af9-059c4088c590 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:40.047454 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecb9ec85-6579-48fb-8af9-059c4088c590 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:40.048180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecb9ec85-6579-48fb-8af9-059c4088c590 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:40.049125 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecb9ec85-6579-48fb-8af9-059c4088c590 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:40.049654 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecb9ec85-6579-48fb-8af9-059c4088c590 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:40.050138 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecb9ec85-6579-48fb-8af9-059c4088c590 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:40.220895 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ecb9ec85-6579-48fb-8af9-059c4088c590 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:40.229552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ecb9ec85-6579-48fb-8af9-059c4088c590 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.196159 Aug 26 08:53:40.230164 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 110/222] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:40 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:40.308101 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c2e4bc09-3d5f-4a5c-8de8-4dff8165887e tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:40.308740 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c2e4bc09-3d5f-4a5c-8de8-4dff8165887e tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:40.310715 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=4 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:40.318004 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2e4bc09-3d5f-4a5c-8de8-4dff8165887e tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:40.318004 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2e4bc09-3d5f-4a5c-8de8-4dff8165887e tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:40.318337 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2e4bc09-3d5f-4a5c-8de8-4dff8165887e tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:40.318999 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2e4bc09-3d5f-4a5c-8de8-4dff8165887e tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:40.319400 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2e4bc09-3d5f-4a5c-8de8-4dff8165887e tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:40.321253 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2e4bc09-3d5f-4a5c-8de8-4dff8165887e tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:40.490676 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=14 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:40.514865 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c2e4bc09-3d5f-4a5c-8de8-4dff8165887e tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:40.517242 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=100 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:40.525930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c2e4bc09-3d5f-4a5c-8de8-4dff8165887e tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1312 microversion: 2.1 time: 0.222303 Aug 26 08:53:40.526593 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 113/223] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:40 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1312 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:40.529017 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d454504c-6da7-4fcd-b415-a608fa49f7be tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:40.530595 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d454504c-6da7-4fcd-b415-a608fa49f7be tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:40.540765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d454504c-6da7-4fcd-b415-a608fa49f7be tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:40.541281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d454504c-6da7-4fcd-b415-a608fa49f7be tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:40.541744 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d454504c-6da7-4fcd-b415-a608fa49f7be tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:40.542493 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d454504c-6da7-4fcd-b415-a608fa49f7be tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:40.543015 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d454504c-6da7-4fcd-b415-a608fa49f7be tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:40.543442 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d454504c-6da7-4fcd-b415-a608fa49f7be tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:40.697981 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d454504c-6da7-4fcd-b415-a608fa49f7be tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:40.707691 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d454504c-6da7-4fcd-b415-a608fa49f7be tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1367 microversion: 2.1 time: 0.184593 Aug 26 08:53:40.708297 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 111/224] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:40 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:41.252203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fa4bcd05-3af7-4848-b004-48b4cdd14074 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:41.252759 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-fa4bcd05-3af7-4848-b004-48b4cdd14074 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:41.260161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa4bcd05-3af7-4848-b004-48b4cdd14074 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:41.260664 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa4bcd05-3af7-4848-b004-48b4cdd14074 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:41.261114 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa4bcd05-3af7-4848-b004-48b4cdd14074 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:41.262151 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa4bcd05-3af7-4848-b004-48b4cdd14074 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:41.262617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa4bcd05-3af7-4848-b004-48b4cdd14074 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:41.263086 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa4bcd05-3af7-4848-b004-48b4cdd14074 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:41.415461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-fa4bcd05-3af7-4848-b004-48b4cdd14074 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:41.423919 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fa4bcd05-3af7-4848-b004-48b4cdd14074 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.176307 Aug 26 08:53:41.424514 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 114/225] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:41 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:41.551136 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4fbcab36-2599-4003-82f8-6da2f2623b92 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:41.552360 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4fbcab36-2599-4003-82f8-6da2f2623b92 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:41.564153 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4fbcab36-2599-4003-82f8-6da2f2623b92 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:41.565017 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4fbcab36-2599-4003-82f8-6da2f2623b92 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:41.565779 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4fbcab36-2599-4003-82f8-6da2f2623b92 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:41.567091 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4fbcab36-2599-4003-82f8-6da2f2623b92 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:41.567875 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4fbcab36-2599-4003-82f8-6da2f2623b92 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:41.568642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4fbcab36-2599-4003-82f8-6da2f2623b92 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:41.590607 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=100 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:41.727071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4fbcab36-2599-4003-82f8-6da2f2623b92 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:41.738469 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-5db2dabc-eb2c-4e42-a246-2f9504fc3682 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:41.739611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-5db2dabc-eb2c-4e42-a246-2f9504fc3682 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:41.739809 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4fbcab36-2599-4003-82f8-6da2f2623b92 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1312 microversion: 2.1 time: 0.194910 Aug 26 08:53:41.741225 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 112/226] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:41 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1312 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:41.751896 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5db2dabc-eb2c-4e42-a246-2f9504fc3682 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:41.752788 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5db2dabc-eb2c-4e42-a246-2f9504fc3682 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:41.753950 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5db2dabc-eb2c-4e42-a246-2f9504fc3682 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:41.754912 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5db2dabc-eb2c-4e42-a246-2f9504fc3682 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:41.755843 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5db2dabc-eb2c-4e42-a246-2f9504fc3682 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:41.756583 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5db2dabc-eb2c-4e42-a246-2f9504fc3682 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:41.940528 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-5db2dabc-eb2c-4e42-a246-2f9504fc3682 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:41.952057 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-5db2dabc-eb2c-4e42-a246-2f9504fc3682 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1367 microversion: 2.1 time: 0.221506 Aug 26 08:53:41.952843 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 115/227] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:41 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:42.445877 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-443232e9-0060-4fb9-b2bc-a59bec505af3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:42.446667 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-443232e9-0060-4fb9-b2bc-a59bec505af3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:42.453906 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-443232e9-0060-4fb9-b2bc-a59bec505af3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:42.454452 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-443232e9-0060-4fb9-b2bc-a59bec505af3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:42.454898 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-443232e9-0060-4fb9-b2bc-a59bec505af3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:42.455642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-443232e9-0060-4fb9-b2bc-a59bec505af3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:42.456090 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-443232e9-0060-4fb9-b2bc-a59bec505af3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:42.456501 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-443232e9-0060-4fb9-b2bc-a59bec505af3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:42.623713 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-443232e9-0060-4fb9-b2bc-a59bec505af3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:42.638626 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-443232e9-0060-4fb9-b2bc-a59bec505af3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1521 microversion: 2.1 time: 0.196455 Aug 26 08:53:42.640173 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 113/228] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:42 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:42.764022 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3bd359fd-709d-4879-a2f9-de1e7f522feb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:42.764640 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3bd359fd-709d-4879-a2f9-de1e7f522feb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:42.771083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3bd359fd-709d-4879-a2f9-de1e7f522feb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:42.771579 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3bd359fd-709d-4879-a2f9-de1e7f522feb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:42.772013 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3bd359fd-709d-4879-a2f9-de1e7f522feb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:42.772726 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3bd359fd-709d-4879-a2f9-de1e7f522feb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:42.773176 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3bd359fd-709d-4879-a2f9-de1e7f522feb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:42.773595 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3bd359fd-709d-4879-a2f9-de1e7f522feb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:42.956178 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3bd359fd-709d-4879-a2f9-de1e7f522feb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:42.965235 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-3bd359fd-709d-4879-a2f9-de1e7f522feb tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1312 microversion: 2.1 time: 0.205010 Aug 26 08:53:42.966099 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 116/229] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:42 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:42.985942 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a5cb6ff9-a18f-47f7-8be5-d40ff3e36356 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:42.986574 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a5cb6ff9-a18f-47f7-8be5-d40ff3e36356 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:42.995303 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5cb6ff9-a18f-47f7-8be5-d40ff3e36356 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:42.995815 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5cb6ff9-a18f-47f7-8be5-d40ff3e36356 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:42.996251 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5cb6ff9-a18f-47f7-8be5-d40ff3e36356 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:42.996990 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5cb6ff9-a18f-47f7-8be5-d40ff3e36356 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:42.997446 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5cb6ff9-a18f-47f7-8be5-d40ff3e36356 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:42.997877 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5cb6ff9-a18f-47f7-8be5-d40ff3e36356 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:43.219569 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a5cb6ff9-a18f-47f7-8be5-d40ff3e36356 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:43.228176 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a5cb6ff9-a18f-47f7-8be5-d40ff3e36356 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1367 microversion: 2.1 time: 0.250281 Aug 26 08:53:43.228775 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 114/230] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:42 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:43.666295 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b70d2daf-d794-4131-824a-04aaa11d516d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:43.667419 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b70d2daf-d794-4131-824a-04aaa11d516d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:43.674044 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b70d2daf-d794-4131-824a-04aaa11d516d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:43.674594 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b70d2daf-d794-4131-824a-04aaa11d516d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:43.675058 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b70d2daf-d794-4131-824a-04aaa11d516d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:43.675767 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b70d2daf-d794-4131-824a-04aaa11d516d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:43.676403 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b70d2daf-d794-4131-824a-04aaa11d516d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:43.676827 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b70d2daf-d794-4131-824a-04aaa11d516d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:43.868669 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b70d2daf-d794-4131-824a-04aaa11d516d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:43.878328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b70d2daf-d794-4131-824a-04aaa11d516d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1501 microversion: 2.1 time: 0.215954 Aug 26 08:53:43.879010 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 117/231] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:43 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1501 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:43.899472 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-53a26d28-52c5-4926-9c6f-81c0874809a7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:43.900341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-53a26d28-52c5-4926-9c6f-81c0874809a7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:43.907122 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-53a26d28-52c5-4926-9c6f-81c0874809a7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:43.907811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-53a26d28-52c5-4926-9c6f-81c0874809a7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:43.908422 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-53a26d28-52c5-4926-9c6f-81c0874809a7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:43.909315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-53a26d28-52c5-4926-9c6f-81c0874809a7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:43.910044 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-53a26d28-52c5-4926-9c6f-81c0874809a7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:43.910457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-53a26d28-52c5-4926-9c6f-81c0874809a7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:43.992787 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-7df407f6-c323-4a5b-98de-2c6757380513 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:43.994671 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-7df407f6-c323-4a5b-98de-2c6757380513 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:44.000898 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7df407f6-c323-4a5b-98de-2c6757380513 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:44.001456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7df407f6-c323-4a5b-98de-2c6757380513 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:44.002279 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7df407f6-c323-4a5b-98de-2c6757380513 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:44.003301 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7df407f6-c323-4a5b-98de-2c6757380513 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:44.003992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7df407f6-c323-4a5b-98de-2c6757380513 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:44.004614 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7df407f6-c323-4a5b-98de-2c6757380513 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:44.173569 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-53a26d28-52c5-4926-9c6f-81c0874809a7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:44.186742 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-53a26d28-52c5-4926-9c6f-81c0874809a7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1516 microversion: 2.1 time: 0.291034 Aug 26 08:53:44.188312 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 115/232] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:43 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1516 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:44.195480 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-870ca731-2a73-4d00-8b1b-17086516f9e6 req-84ecd8bf-dcc3-47da-a939-531602a7ed45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e441bb-c7f1-4f57-a936-ae82ddea56c5", "name": "network-vif-plugged", "status": "completed", "tag": "577f1e58-da5c-4628-a0bd-bcf24fc8842e"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:44.216492 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-870ca731-2a73-4d00-8b1b-17086516f9e6 req-84ecd8bf-dcc3-47da-a939-531602a7ed45 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:44.217360 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-870ca731-2a73-4d00-8b1b-17086516f9e6 req-84ecd8bf-dcc3-47da-a939-531602a7ed45 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:44.218504 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-870ca731-2a73-4d00-8b1b-17086516f9e6 req-84ecd8bf-dcc3-47da-a939-531602a7ed45 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:44.237405 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-870ca731-2a73-4d00-8b1b-17086516f9e6 req-84ecd8bf-dcc3-47da-a939-531602a7ed45 service nova] Creating event network-vif-plugged:577f1e58-da5c-4628-a0bd-bcf24fc8842e for instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 on hv-cinder-85236 Aug 26 08:53:44.248108 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-870ca731-2a73-4d00-8b1b-17086516f9e6 req-84ecd8bf-dcc3-47da-a939-531602a7ed45 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056946 Aug 26 08:53:44.250451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 116/233] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:53:44.258035 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-60ef4a5d-9f35-4cbf-a372-ba989d7b25ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:44.259486 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-60ef4a5d-9f35-4cbf-a372-ba989d7b25ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:44.283145 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60ef4a5d-9f35-4cbf-a372-ba989d7b25ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:44.284304 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60ef4a5d-9f35-4cbf-a372-ba989d7b25ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:44.285826 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60ef4a5d-9f35-4cbf-a372-ba989d7b25ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:44.287261 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60ef4a5d-9f35-4cbf-a372-ba989d7b25ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:44.287966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60ef4a5d-9f35-4cbf-a372-ba989d7b25ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:44.288677 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60ef4a5d-9f35-4cbf-a372-ba989d7b25ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:44.400181 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7df407f6-c323-4a5b-98de-2c6757380513 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:44.412543 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-7df407f6-c323-4a5b-98de-2c6757380513 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1312 microversion: 2.1 time: 0.424237 Aug 26 08:53:44.413172 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 118/234] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:43 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1312 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:44.880680 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-60ef4a5d-9f35-4cbf-a372-ba989d7b25ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:44.889812 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-60ef4a5d-9f35-4cbf-a372-ba989d7b25ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1367 microversion: 2.1 time: 0.637411 Aug 26 08:53:44.890400 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 117/235] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:44 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1367 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:45.442104 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-88d55f41-249c-4ead-8ed7-36a7332849fe tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:45.443396 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-88d55f41-249c-4ead-8ed7-36a7332849fe tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:45.449939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-88d55f41-249c-4ead-8ed7-36a7332849fe tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:45.450416 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-88d55f41-249c-4ead-8ed7-36a7332849fe tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:45.450842 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-88d55f41-249c-4ead-8ed7-36a7332849fe tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:45.451603 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-88d55f41-249c-4ead-8ed7-36a7332849fe tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:45.452068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-88d55f41-249c-4ead-8ed7-36a7332849fe tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:45.452688 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-88d55f41-249c-4ead-8ed7-36a7332849fe tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:45.620389 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-88d55f41-249c-4ead-8ed7-36a7332849fe tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:45.630967 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-88d55f41-249c-4ead-8ed7-36a7332849fe tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1312 microversion: 2.1 time: 0.192788 Aug 26 08:53:45.632128 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 119/236] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:45 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:45.920473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f0b6f183-edcc-44ab-8049-829ee4960f26 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:45.922004 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f0b6f183-edcc-44ab-8049-829ee4960f26 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:45.926973 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:45.939049 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0b6f183-edcc-44ab-8049-829ee4960f26 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:45.940215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0b6f183-edcc-44ab-8049-829ee4960f26 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:45.940927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0b6f183-edcc-44ab-8049-829ee4960f26 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:45.945771 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0b6f183-edcc-44ab-8049-829ee4960f26 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:45.946066 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-5bd30a29-cf12-40f3-8a72-ab925f1722d7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:45.947355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0b6f183-edcc-44ab-8049-829ee4960f26 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:45.948290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0b6f183-edcc-44ab-8049-829ee4960f26 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:45.949589 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-5bd30a29-cf12-40f3-8a72-ab925f1722d7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:45.958736 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5bd30a29-cf12-40f3-8a72-ab925f1722d7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:45.959630 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5bd30a29-cf12-40f3-8a72-ab925f1722d7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:45.960224 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5bd30a29-cf12-40f3-8a72-ab925f1722d7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:45.961194 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5bd30a29-cf12-40f3-8a72-ab925f1722d7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:45.962091 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5bd30a29-cf12-40f3-8a72-ab925f1722d7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:45.962863 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5bd30a29-cf12-40f3-8a72-ab925f1722d7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:46.002576 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-5bd30a29-cf12-40f3-8a72-ab925f1722d7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lazy-loading 'flavor' on Instance uuid 1a8b026c-ef95-4a38-8eca-86005625dd30 {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:53:46.097547 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-5bd30a29-cf12-40f3-8a72-ab925f1722d7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "POST /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30/action" status: 200 len: 32 microversion: 2.1 time: 0.158007 Aug 26 08:53:46.098184 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 120/237] 10.222.0.71 () {60 vars in 1278 bytes} [Fri Aug 26 08:53:45 2022] POST /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 08:53:46.109069 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6102732d-80d4-49bd-af6b-2893665e84c0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:46.109762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6102732d-80d4-49bd-af6b-2893665e84c0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:46.116448 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6102732d-80d4-49bd-af6b-2893665e84c0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:46.116935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6102732d-80d4-49bd-af6b-2893665e84c0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:46.117712 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6102732d-80d4-49bd-af6b-2893665e84c0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:46.118975 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6102732d-80d4-49bd-af6b-2893665e84c0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:46.118975 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6102732d-80d4-49bd-af6b-2893665e84c0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:46.119320 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6102732d-80d4-49bd-af6b-2893665e84c0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:46.202936 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f0b6f183-edcc-44ab-8049-829ee4960f26 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:46.230944 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f0b6f183-edcc-44ab-8049-829ee4960f26 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1367 microversion: 2.1 time: 0.319160 Aug 26 08:53:46.231811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 118/238] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:45 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:46.280583 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-79a667ba-430e-44a0-a46a-cc33660f68b0 req-ea026fd4-bbd0-4db7-9d02-15badb8b8d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8b7b79-29d0-4a40-9f13-94198c5d2fbd", "name": "network-vif-plugged", "status": "completed", "tag": "71e6d342-8d25-44d8-99eb-50fd5e431bc4"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:46.296678 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-79a667ba-430e-44a0-a46a-cc33660f68b0 req-ea026fd4-bbd0-4db7-9d02-15badb8b8d8e service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:46.297263 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-79a667ba-430e-44a0-a46a-cc33660f68b0 req-ea026fd4-bbd0-4db7-9d02-15badb8b8d8e service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:46.298531 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-79a667ba-430e-44a0-a46a-cc33660f68b0 req-ea026fd4-bbd0-4db7-9d02-15badb8b8d8e service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:46.339435 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-79a667ba-430e-44a0-a46a-cc33660f68b0 req-ea026fd4-bbd0-4db7-9d02-15badb8b8d8e service nova] Creating event network-vif-plugged:71e6d342-8d25-44d8-99eb-50fd5e431bc4 for instance 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd on hv-cinder-85236 Aug 26 08:53:46.350005 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-79a667ba-430e-44a0-a46a-cc33660f68b0 req-ea026fd4-bbd0-4db7-9d02-15badb8b8d8e service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078453 Aug 26 08:53:46.351632 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 119/239] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:53:46.403741 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6102732d-80d4-49bd-af6b-2893665e84c0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:46.417980 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6102732d-80d4-49bd-af6b-2893665e84c0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.313218 Aug 26 08:53:46.418863 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 121/240] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:46 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:46.657534 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-dc16a66b-b01e-4db2-8f0d-f5b94a11834c tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:46.658544 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-dc16a66b-b01e-4db2-8f0d-f5b94a11834c tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:46.670276 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc16a66b-b01e-4db2-8f0d-f5b94a11834c tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:46.672243 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc16a66b-b01e-4db2-8f0d-f5b94a11834c tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:46.672782 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc16a66b-b01e-4db2-8f0d-f5b94a11834c tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:46.673861 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc16a66b-b01e-4db2-8f0d-f5b94a11834c tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:46.674696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc16a66b-b01e-4db2-8f0d-f5b94a11834c tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:46.675413 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc16a66b-b01e-4db2-8f0d-f5b94a11834c tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:46.901000 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-dc16a66b-b01e-4db2-8f0d-f5b94a11834c tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:46.915750 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-dc16a66b-b01e-4db2-8f0d-f5b94a11834c tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1312 microversion: 2.1 time: 0.263901 Aug 26 08:53:46.916628 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 120/241] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:46 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1312 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:47.261690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-47eb7613-4750-439c-94b6-3141eb4f45d4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:47.263655 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-47eb7613-4750-439c-94b6-3141eb4f45d4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:47.275103 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47eb7613-4750-439c-94b6-3141eb4f45d4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:47.276134 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47eb7613-4750-439c-94b6-3141eb4f45d4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:47.277095 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47eb7613-4750-439c-94b6-3141eb4f45d4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:47.279356 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47eb7613-4750-439c-94b6-3141eb4f45d4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:47.280491 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47eb7613-4750-439c-94b6-3141eb4f45d4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:47.281403 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47eb7613-4750-439c-94b6-3141eb4f45d4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:47.446503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f12a09bf-1d92-456e-939b-1df4bb461eb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:47.447803 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f12a09bf-1d92-456e-939b-1df4bb461eb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:47.458677 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f12a09bf-1d92-456e-939b-1df4bb461eb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:47.459398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f12a09bf-1d92-456e-939b-1df4bb461eb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:47.459949 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f12a09bf-1d92-456e-939b-1df4bb461eb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:47.460855 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f12a09bf-1d92-456e-939b-1df4bb461eb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:47.461749 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f12a09bf-1d92-456e-939b-1df4bb461eb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:47.462120 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f12a09bf-1d92-456e-939b-1df4bb461eb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:47.630693 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f12a09bf-1d92-456e-939b-1df4bb461eb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:47.643797 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f12a09bf-1d92-456e-939b-1df4bb461eb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.204356 Aug 26 08:53:47.645634 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 121/242] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:47 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:47.728070 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-47eb7613-4750-439c-94b6-3141eb4f45d4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:47.738771 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-47eb7613-4750-439c-94b6-3141eb4f45d4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1557 microversion: 2.1 time: 0.485288 Aug 26 08:53:47.739686 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 122/243] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:47 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1557 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:47.764624 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3d6d59a7-db44-4248-979f-955daf235533 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:47.765424 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3d6d59a7-db44-4248-979f-955daf235533 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:47.772657 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3d6d59a7-db44-4248-979f-955daf235533 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:47.773241 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3d6d59a7-db44-4248-979f-955daf235533 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:47.773673 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3d6d59a7-db44-4248-979f-955daf235533 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:47.774385 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3d6d59a7-db44-4248-979f-955daf235533 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:47.774833 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3d6d59a7-db44-4248-979f-955daf235533 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:47.775294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3d6d59a7-db44-4248-979f-955daf235533 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:47.888855 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3d6d59a7-db44-4248-979f-955daf235533 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127893 Aug 26 08:53:47.889966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 122/244] 10.222.0.71 () {58 vars in 1275 bytes} [Fri Aug 26 08:53:47 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:53:47.942039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-72c2d469-91ad-417c-a71e-2bf9d238e376 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:47.943421 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-72c2d469-91ad-417c-a71e-2bf9d238e376 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:47.954118 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-72c2d469-91ad-417c-a71e-2bf9d238e376 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:47.955039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-72c2d469-91ad-417c-a71e-2bf9d238e376 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:47.955841 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-72c2d469-91ad-417c-a71e-2bf9d238e376 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:47.957111 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-72c2d469-91ad-417c-a71e-2bf9d238e376 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:47.957929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-72c2d469-91ad-417c-a71e-2bf9d238e376 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:47.958714 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-72c2d469-91ad-417c-a71e-2bf9d238e376 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:48.389793 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-72c2d469-91ad-417c-a71e-2bf9d238e376 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:48.403535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-72c2d469-91ad-417c-a71e-2bf9d238e376 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1312 microversion: 2.1 time: 0.468225 Aug 26 08:53:48.404153 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 123/245] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:47 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1312 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:48.683762 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0be77a4e-6cba-4477-ac8d-c5e828d651f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:48.684494 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0be77a4e-6cba-4477-ac8d-c5e828d651f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:48.695159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0be77a4e-6cba-4477-ac8d-c5e828d651f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:48.695653 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0be77a4e-6cba-4477-ac8d-c5e828d651f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:48.696338 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0be77a4e-6cba-4477-ac8d-c5e828d651f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:48.697068 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0be77a4e-6cba-4477-ac8d-c5e828d651f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:48.698327 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0be77a4e-6cba-4477-ac8d-c5e828d651f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:48.698516 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0be77a4e-6cba-4477-ac8d-c5e828d651f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:49.070301 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0be77a4e-6cba-4477-ac8d-c5e828d651f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:49.086076 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0be77a4e-6cba-4477-ac8d-c5e828d651f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.406614 Aug 26 08:53:49.087165 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 123/246] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:48 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:49.450836 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6b57236c-c778-42a0-907c-474641f29538 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:49.452214 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6b57236c-c778-42a0-907c-474641f29538 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:49.471994 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b57236c-c778-42a0-907c-474641f29538 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:49.472815 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b57236c-c778-42a0-907c-474641f29538 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:49.473258 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b57236c-c778-42a0-907c-474641f29538 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:49.474189 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b57236c-c778-42a0-907c-474641f29538 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:49.474817 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b57236c-c778-42a0-907c-474641f29538 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:49.475440 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b57236c-c778-42a0-907c-474641f29538 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:50.112941 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c67eb58a-a986-435e-aba5-e734efe4f7fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:50.113991 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c67eb58a-a986-435e-aba5-e734efe4f7fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:50.130362 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c67eb58a-a986-435e-aba5-e734efe4f7fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:50.131739 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c67eb58a-a986-435e-aba5-e734efe4f7fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:50.133659 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c67eb58a-a986-435e-aba5-e734efe4f7fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:50.135532 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c67eb58a-a986-435e-aba5-e734efe4f7fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:50.136894 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c67eb58a-a986-435e-aba5-e734efe4f7fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:50.138048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c67eb58a-a986-435e-aba5-e734efe4f7fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:50.179125 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6b57236c-c778-42a0-907c-474641f29538 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:50.192015 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6b57236c-c778-42a0-907c-474641f29538 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1312 microversion: 2.1 time: 0.746034 Aug 26 08:53:50.193382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 124/247] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:49 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1312 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:50.476118 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c67eb58a-a986-435e-aba5-e734efe4f7fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:50.488265 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c67eb58a-a986-435e-aba5-e734efe4f7fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.383024 Aug 26 08:53:50.489663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 124/248] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:50 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:50.520799 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-c37faafc-6cbd-406f-ad10-682b97b0271b req-d52f7f5c-d17b-471c-b658-337ead705415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e441bb-c7f1-4f57-a936-ae82ddea56c5", "tag": "577f1e58-da5c-4628-a0bd-bcf24fc8842e"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:50.531670 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-c37faafc-6cbd-406f-ad10-682b97b0271b req-d52f7f5c-d17b-471c-b658-337ead705415 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:50.533010 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-c37faafc-6cbd-406f-ad10-682b97b0271b req-d52f7f5c-d17b-471c-b658-337ead705415 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:50.533010 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-c37faafc-6cbd-406f-ad10-682b97b0271b req-d52f7f5c-d17b-471c-b658-337ead705415 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:50.547572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-c37faafc-6cbd-406f-ad10-682b97b0271b req-d52f7f5c-d17b-471c-b658-337ead705415 service nova] Creating event network-changed:577f1e58-da5c-4628-a0bd-bcf24fc8842e for instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 on hv-cinder-85236 Aug 26 08:53:50.553347 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-c37faafc-6cbd-406f-ad10-682b97b0271b req-d52f7f5c-d17b-471c-b658-337ead705415 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036222 Aug 26 08:53:50.554376 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 125/249] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:53:51.241190 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-87a255ac-42b1-438a-a313-f0bbbd02bfa5 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:51.243244 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-87a255ac-42b1-438a-a313-f0bbbd02bfa5 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:51.260209 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-87a255ac-42b1-438a-a313-f0bbbd02bfa5 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:51.263734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-87a255ac-42b1-438a-a313-f0bbbd02bfa5 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:51.269546 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-87a255ac-42b1-438a-a313-f0bbbd02bfa5 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:51.271845 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-87a255ac-42b1-438a-a313-f0bbbd02bfa5 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:51.272704 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-87a255ac-42b1-438a-a313-f0bbbd02bfa5 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:51.279249 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-87a255ac-42b1-438a-a313-f0bbbd02bfa5 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:51.511950 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f6363aff-7928-4ee9-9e19-1242031a3048 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:51.513017 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f6363aff-7928-4ee9-9e19-1242031a3048 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:51.537117 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f6363aff-7928-4ee9-9e19-1242031a3048 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:51.547659 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f6363aff-7928-4ee9-9e19-1242031a3048 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:51.550523 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f6363aff-7928-4ee9-9e19-1242031a3048 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:51.551900 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f6363aff-7928-4ee9-9e19-1242031a3048 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:51.552773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f6363aff-7928-4ee9-9e19-1242031a3048 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:51.553524 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f6363aff-7928-4ee9-9e19-1242031a3048 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:51.750324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-87a255ac-42b1-438a-a313-f0bbbd02bfa5 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:51.771502 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-87a255ac-42b1-438a-a313-f0bbbd02bfa5 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1496 microversion: 2.1 time: 0.541310 Aug 26 08:53:51.780172 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 125/250] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:51 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1496 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:51.913823 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f6363aff-7928-4ee9-9e19-1242031a3048 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:51.924169 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f6363aff-7928-4ee9-9e19-1242031a3048 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.417071 Aug 26 08:53:51.925080 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 126/251] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:51 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:52.624092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-af13a7fe-515f-498e-82db-37b1b9d33d85 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:52.625398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-af13a7fe-515f-498e-82db-37b1b9d33d85 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:52.647458 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af13a7fe-515f-498e-82db-37b1b9d33d85 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:52.650473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af13a7fe-515f-498e-82db-37b1b9d33d85 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:52.650991 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af13a7fe-515f-498e-82db-37b1b9d33d85 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:52.652677 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af13a7fe-515f-498e-82db-37b1b9d33d85 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:52.654091 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af13a7fe-515f-498e-82db-37b1b9d33d85 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:52.654532 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af13a7fe-515f-498e-82db-37b1b9d33d85 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:52.718369 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-af13a7fe-515f-498e-82db-37b1b9d33d85 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 08:53:52.877616 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-af13a7fe-515f-498e-82db-37b1b9d33d85 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "DELETE /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 204 len: 0 microversion: 2.1 time: 0.257458 Aug 26 08:53:52.881462 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 126/252] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 08:53:52 2022] DELETE /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:53:52.894603 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e7c61bc6-ec0f-4c9d-bd1e-071380968f00 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:52.896773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e7c61bc6-ec0f-4c9d-bd1e-071380968f00 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:52.920673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e7c61bc6-ec0f-4c9d-bd1e-071380968f00 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:52.927159 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e7c61bc6-ec0f-4c9d-bd1e-071380968f00 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:52.927785 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e7c61bc6-ec0f-4c9d-bd1e-071380968f00 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:52.931955 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e7c61bc6-ec0f-4c9d-bd1e-071380968f00 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:52.932771 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e7c61bc6-ec0f-4c9d-bd1e-071380968f00 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:52.933409 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e7c61bc6-ec0f-4c9d-bd1e-071380968f00 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:52.950186 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f0cc0714-8616-4d09-8c96-3b5276c0ac48 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:52.952115 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f0cc0714-8616-4d09-8c96-3b5276c0ac48 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:52.963883 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0cc0714-8616-4d09-8c96-3b5276c0ac48 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:52.971430 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0cc0714-8616-4d09-8c96-3b5276c0ac48 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:52.972228 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0cc0714-8616-4d09-8c96-3b5276c0ac48 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:52.975866 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0cc0714-8616-4d09-8c96-3b5276c0ac48 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:52.976773 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0cc0714-8616-4d09-8c96-3b5276c0ac48 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:52.977445 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0cc0714-8616-4d09-8c96-3b5276c0ac48 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:53.223020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e7c61bc6-ec0f-4c9d-bd1e-071380968f00 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:53.237607 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e7c61bc6-ec0f-4c9d-bd1e-071380968f00 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1502 microversion: 2.1 time: 0.353853 Aug 26 08:53:53.239558 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 127/253] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:52 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1502 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:53.277711 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f0cc0714-8616-4d09-8c96-3b5276c0ac48 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:53.292585 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f0cc0714-8616-4d09-8c96-3b5276c0ac48 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.349290 Aug 26 08:53:53.293196 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 127/254] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:52 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:54.261584 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-09fe9539-5328-43cd-bfc4-613478fe3ed4 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:54.262374 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-09fe9539-5328-43cd-bfc4-613478fe3ed4 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:54.265704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:54.270066 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09fe9539-5328-43cd-bfc4-613478fe3ed4 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:54.270844 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09fe9539-5328-43cd-bfc4-613478fe3ed4 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:54.271352 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09fe9539-5328-43cd-bfc4-613478fe3ed4 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:54.272127 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09fe9539-5328-43cd-bfc4-613478fe3ed4 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:54.272574 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09fe9539-5328-43cd-bfc4-613478fe3ed4 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:54.273167 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09fe9539-5328-43cd-bfc4-613478fe3ed4 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:54.313970 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-29c6479d-1720-4b2b-bcf0-b5336eb4903a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:54.314855 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-29c6479d-1720-4b2b-bcf0-b5336eb4903a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:54.326782 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-29c6479d-1720-4b2b-bcf0-b5336eb4903a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:54.327505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-29c6479d-1720-4b2b-bcf0-b5336eb4903a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:54.328068 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-29c6479d-1720-4b2b-bcf0-b5336eb4903a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:54.329903 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-29c6479d-1720-4b2b-bcf0-b5336eb4903a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:54.330683 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-29c6479d-1720-4b2b-bcf0-b5336eb4903a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:54.332006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-29c6479d-1720-4b2b-bcf0-b5336eb4903a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:54.525611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-09fe9539-5328-43cd-bfc4-613478fe3ed4 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:54.539883 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-09fe9539-5328-43cd-bfc4-613478fe3ed4 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1502 microversion: 2.1 time: 0.282352 Aug 26 08:53:54.541672 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 128/255] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:54 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:54.554363 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-cfe2dab6-037a-4d3f-bc74-5718d8002592 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:54.556335 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-cfe2dab6-037a-4d3f-bc74-5718d8002592 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:54.571906 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cfe2dab6-037a-4d3f-bc74-5718d8002592 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:54.572950 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cfe2dab6-037a-4d3f-bc74-5718d8002592 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:54.573826 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cfe2dab6-037a-4d3f-bc74-5718d8002592 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:54.575310 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cfe2dab6-037a-4d3f-bc74-5718d8002592 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:54.577045 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cfe2dab6-037a-4d3f-bc74-5718d8002592 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:54.578152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cfe2dab6-037a-4d3f-bc74-5718d8002592 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:54.585687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:54.671446 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-cfe2dab6-037a-4d3f-bc74-5718d8002592 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/ips" status: 200 len: 147 microversion: 2.1 time: 0.127320 Aug 26 08:53:54.672983 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 129/256] 10.222.0.71 () {58 vars in 1248 bytes} [Fri Aug 26 08:53:54 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/ips => generated 147 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:53:54.776046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-29c6479d-1720-4b2b-bcf0-b5336eb4903a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:54.786036 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-29c6479d-1720-4b2b-bcf0-b5336eb4903a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.475849 Aug 26 08:53:54.787025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 128/257] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:54 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:55.565570 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-84dd9e57-b540-4b5b-90b0-4386fb77d751 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:55.566751 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-84dd9e57-b540-4b5b-90b0-4386fb77d751 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:55.580630 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84dd9e57-b540-4b5b-90b0-4386fb77d751 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:55.581574 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84dd9e57-b540-4b5b-90b0-4386fb77d751 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:55.582721 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84dd9e57-b540-4b5b-90b0-4386fb77d751 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:55.584960 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84dd9e57-b540-4b5b-90b0-4386fb77d751 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:55.584960 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84dd9e57-b540-4b5b-90b0-4386fb77d751 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:55.585538 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84dd9e57-b540-4b5b-90b0-4386fb77d751 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:55.813915 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6a722287-6cf5-412d-9114-d537c57fd56d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:55.833142 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6a722287-6cf5-412d-9114-d537c57fd56d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:55.863681 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a722287-6cf5-412d-9114-d537c57fd56d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:55.864537 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a722287-6cf5-412d-9114-d537c57fd56d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:55.865278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a722287-6cf5-412d-9114-d537c57fd56d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:55.866514 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a722287-6cf5-412d-9114-d537c57fd56d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:55.867708 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a722287-6cf5-412d-9114-d537c57fd56d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:55.868560 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a722287-6cf5-412d-9114-d537c57fd56d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:55.878236 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:53:56.029209 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-84dd9e57-b540-4b5b-90b0-4386fb77d751 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:56.055375 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-84dd9e57-b540-4b5b-90b0-4386fb77d751 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1502 microversion: 2.1 time: 0.495513 Aug 26 08:53:56.057182 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 130/258] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:55 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1502 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:56.261532 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6a722287-6cf5-412d-9114-d537c57fd56d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:56.303977 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6a722287-6cf5-412d-9114-d537c57fd56d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.497543 Aug 26 08:53:56.311117 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 129/259] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:55 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:57.109998 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-dd6f665f-c065-4ccb-9811-f0b390b9e599 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:57.113762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-dd6f665f-c065-4ccb-9811-f0b390b9e599 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:57.132916 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd6f665f-c065-4ccb-9811-f0b390b9e599 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:57.136482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd6f665f-c065-4ccb-9811-f0b390b9e599 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:57.141967 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd6f665f-c065-4ccb-9811-f0b390b9e599 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:57.147754 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd6f665f-c065-4ccb-9811-f0b390b9e599 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:57.148686 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd6f665f-c065-4ccb-9811-f0b390b9e599 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:57.149394 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd6f665f-c065-4ccb-9811-f0b390b9e599 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:57.330470 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-cb689753-fb4e-49c3-b104-54f3cb2078fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:57.331343 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-cb689753-fb4e-49c3-b104-54f3cb2078fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:57.342931 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cb689753-fb4e-49c3-b104-54f3cb2078fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:57.343500 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cb689753-fb4e-49c3-b104-54f3cb2078fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:57.347306 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cb689753-fb4e-49c3-b104-54f3cb2078fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:57.348238 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cb689753-fb4e-49c3-b104-54f3cb2078fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:57.348739 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cb689753-fb4e-49c3-b104-54f3cb2078fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:57.355953 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cb689753-fb4e-49c3-b104-54f3cb2078fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:57.499465 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-dd6f665f-c065-4ccb-9811-f0b390b9e599 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:57.514745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-dd6f665f-c065-4ccb-9811-f0b390b9e599 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1502 microversion: 2.1 time: 0.424016 Aug 26 08:53:57.515419 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 131/260] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:57 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1502 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:53:57.602838 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-cb689753-fb4e-49c3-b104-54f3cb2078fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:57.618033 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-cb689753-fb4e-49c3-b104-54f3cb2078fb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.291210 Aug 26 08:53:57.619741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 130/261] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:57 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:58.544700 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-bdbb0f93-fc18-4483-b2a1-12dd5758970b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:58.545985 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-bdbb0f93-fc18-4483-b2a1-12dd5758970b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:58.563546 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bdbb0f93-fc18-4483-b2a1-12dd5758970b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:58.564862 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bdbb0f93-fc18-4483-b2a1-12dd5758970b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:58.566266 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bdbb0f93-fc18-4483-b2a1-12dd5758970b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:58.567589 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bdbb0f93-fc18-4483-b2a1-12dd5758970b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:58.568682 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bdbb0f93-fc18-4483-b2a1-12dd5758970b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:58.569811 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bdbb0f93-fc18-4483-b2a1-12dd5758970b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:58.571536 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8e08e258-205a-4a45-8265-9ad897de5ee4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2d8c9c5-7e0f-4f31-a34e-bc692135a383"}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:53:58.581264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8e08e258-205a-4a45-8265-9ad897de5ee4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:58.599111 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8e08e258-205a-4a45-8265-9ad897de5ee4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:58.599616 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8e08e258-205a-4a45-8265-9ad897de5ee4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:58.600056 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8e08e258-205a-4a45-8265-9ad897de5ee4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:58.604394 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8e08e258-205a-4a45-8265-9ad897de5ee4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:58.604922 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8e08e258-205a-4a45-8265-9ad897de5ee4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:58.605365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8e08e258-205a-4a45-8265-9ad897de5ee4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:59.110943 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8e08e258-205a-4a45-8265-9ad897de5ee4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "POST /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.548368 Aug 26 08:53:59.111785 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 131/262] 10.222.0.71 () {60 vars in 1323 bytes} [Fri Aug 26 08:53:58 2022] POST /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:53:59.128364 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b782440e-e5ba-4157-9504-1e58fe265db0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:59.129530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b782440e-e5ba-4157-9504-1e58fe265db0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:59.151865 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b782440e-e5ba-4157-9504-1e58fe265db0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:59.155413 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b782440e-e5ba-4157-9504-1e58fe265db0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:59.156355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b782440e-e5ba-4157-9504-1e58fe265db0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:59.159390 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b782440e-e5ba-4157-9504-1e58fe265db0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:59.165398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b782440e-e5ba-4157-9504-1e58fe265db0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:59.166426 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b782440e-e5ba-4157-9504-1e58fe265db0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:59.253237 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bdbb0f93-fc18-4483-b2a1-12dd5758970b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:59.271866 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-bdbb0f93-fc18-4483-b2a1-12dd5758970b tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1502 microversion: 2.1 time: 0.734496 Aug 26 08:53:59.272481 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 132/263] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:58 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1502 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:53:59.292157 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a9be88ab-7cd9-4655-98c6-7185d830b503 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:53:59.295808 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a9be88ab-7cd9-4655-98c6-7185d830b503 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:53:59.307345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a9be88ab-7cd9-4655-98c6-7185d830b503 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:59.309076 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a9be88ab-7cd9-4655-98c6-7185d830b503 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:59.309608 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a9be88ab-7cd9-4655-98c6-7185d830b503 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:59.311138 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a9be88ab-7cd9-4655-98c6-7185d830b503 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:53:59.311911 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a9be88ab-7cd9-4655-98c6-7185d830b503 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:53:59.314280 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a9be88ab-7cd9-4655-98c6-7185d830b503 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:53:59.390730 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a9be88ab-7cd9-4655-98c6-7185d830b503 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/ips" status: 200 len: 150 microversion: 2.20 time: 0.112120 Aug 26 08:53:59.391835 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 133/264] 10.222.0.71 () {60 vars in 1289 bytes} [Fri Aug 26 08:53:59 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/ips => generated 150 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:53:59.480431 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b782440e-e5ba-4157-9504-1e58fe265db0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:53:59.495279 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b782440e-e5ba-4157-9504-1e58fe265db0 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.380938 Aug 26 08:53:59.496307 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 132/265] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:53:59 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:00.302347 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3293d07e-141c-4fbb-a072-e61858711d2f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:00.303989 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3293d07e-141c-4fbb-a072-e61858711d2f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:00.321077 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3293d07e-141c-4fbb-a072-e61858711d2f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:00.322377 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3293d07e-141c-4fbb-a072-e61858711d2f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:00.322824 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3293d07e-141c-4fbb-a072-e61858711d2f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:00.329848 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-b6ad9f87-b0a7-4b2e-9965-0510fc1df455 req-7911b2b6-a97a-4f2e-a12e-cbeeb25f43d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8b7b79-29d0-4a40-9f13-94198c5d2fbd", "name": "network-vif-deleted", "tag": "71e6d342-8d25-44d8-99eb-50fd5e431bc4"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:54:00.330981 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3293d07e-141c-4fbb-a072-e61858711d2f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:00.331824 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3293d07e-141c-4fbb-a072-e61858711d2f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:00.332287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3293d07e-141c-4fbb-a072-e61858711d2f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:00.343457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-b6ad9f87-b0a7-4b2e-9965-0510fc1df455 req-7911b2b6-a97a-4f2e-a12e-cbeeb25f43d0 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:00.344270 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-b6ad9f87-b0a7-4b2e-9965-0510fc1df455 req-7911b2b6-a97a-4f2e-a12e-cbeeb25f43d0 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:00.344915 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-b6ad9f87-b0a7-4b2e-9965-0510fc1df455 req-7911b2b6-a97a-4f2e-a12e-cbeeb25f43d0 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:00.362505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-b6ad9f87-b0a7-4b2e-9965-0510fc1df455 req-7911b2b6-a97a-4f2e-a12e-cbeeb25f43d0 service nova] Creating event network-vif-deleted:71e6d342-8d25-44d8-99eb-50fd5e431bc4 for instance 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd on hv-cinder-85236 Aug 26 08:54:00.370131 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-b6ad9f87-b0a7-4b2e-9965-0510fc1df455 req-7911b2b6-a97a-4f2e-a12e-cbeeb25f43d0 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044385 Aug 26 08:54:00.378860 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 133/266] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:54:00.503207 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3293d07e-141c-4fbb-a072-e61858711d2f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:00.513094 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-3293d07e-141c-4fbb-a072-e61858711d2f tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1460 microversion: 2.1 time: 0.217643 Aug 26 08:54:00.515973 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 134/267] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:00 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1460 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:00.523205 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ce02ed2a-9056-4f8d-854d-4ea3b4523791 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:00.524252 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ce02ed2a-9056-4f8d-854d-4ea3b4523791 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:00.537099 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce02ed2a-9056-4f8d-854d-4ea3b4523791 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:00.537708 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce02ed2a-9056-4f8d-854d-4ea3b4523791 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:00.538204 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce02ed2a-9056-4f8d-854d-4ea3b4523791 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:00.539177 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce02ed2a-9056-4f8d-854d-4ea3b4523791 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:00.539816 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce02ed2a-9056-4f8d-854d-4ea3b4523791 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:00.540350 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ce02ed2a-9056-4f8d-854d-4ea3b4523791 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:00.939586 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ce02ed2a-9056-4f8d-854d-4ea3b4523791 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:00.952499 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ce02ed2a-9056-4f8d-854d-4ea3b4523791 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.433723 Aug 26 08:54:00.966230 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 134/268] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:00 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:01.539329 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-27809599-f746-4616-8da6-48c224529605 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:01.539329 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-27809599-f746-4616-8da6-48c224529605 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:01.548507 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27809599-f746-4616-8da6-48c224529605 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:01.548962 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27809599-f746-4616-8da6-48c224529605 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:01.549388 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27809599-f746-4616-8da6-48c224529605 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:01.550105 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27809599-f746-4616-8da6-48c224529605 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:01.550550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27809599-f746-4616-8da6-48c224529605 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:01.552384 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27809599-f746-4616-8da6-48c224529605 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:01.619709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27809599-f746-4616-8da6-48c224529605 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:01.620407 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27809599-f746-4616-8da6-48c224529605 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:01.620850 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27809599-f746-4616-8da6-48c224529605 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:01.621310 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-27809599-f746-4616-8da6-48c224529605 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lazy-loading 'fault' on Instance uuid 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:54:01.682724 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-27809599-f746-4616-8da6-48c224529605 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230efbe75687494fa44777325c8acb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196b8882c5344c8380fecba536f39214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:01.691413 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-27809599-f746-4616-8da6-48c224529605 tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 200 len: 1302 microversion: 2.1 time: 0.156969 Aug 26 08:54:01.705876 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 135/269] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:01 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 1302 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:54:01.953727 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-83b8a87f-9f09-4336-b2f4-ebaa53e8d20e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:54:01.954637 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-83b8a87f-9f09-4336-b2f4-ebaa53e8d20e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:01.971765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-83b8a87f-9f09-4336-b2f4-ebaa53e8d20e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:01.972757 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-83b8a87f-9f09-4336-b2f4-ebaa53e8d20e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:01.973421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-83b8a87f-9f09-4336-b2f4-ebaa53e8d20e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:01.974395 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-83b8a87f-9f09-4336-b2f4-ebaa53e8d20e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:01.974979 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-83b8a87f-9f09-4336-b2f4-ebaa53e8d20e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:01.975605 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-83b8a87f-9f09-4336-b2f4-ebaa53e8d20e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:01.982937 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1a45bc19-88fc-4f67-84e2-20364d907f8e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:01.985557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1a45bc19-88fc-4f67-84e2-20364d907f8e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:02.007831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a45bc19-88fc-4f67-84e2-20364d907f8e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:02.010784 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a45bc19-88fc-4f67-84e2-20364d907f8e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:02.016998 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a45bc19-88fc-4f67-84e2-20364d907f8e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:02.019097 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a45bc19-88fc-4f67-84e2-20364d907f8e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:02.021167 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a45bc19-88fc-4f67-84e2-20364d907f8e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:02.023093 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a45bc19-88fc-4f67-84e2-20364d907f8e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:02.023401 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-83b8a87f-9f09-4336-b2f4-ebaa53e8d20e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lazy-loading 'flavor' on Instance uuid 8de0d2d4-3218-426b-a548-91c5891780fa {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:54:02.429822 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1a45bc19-88fc-4f67-84e2-20364d907f8e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:02.449684 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1a45bc19-88fc-4f67-84e2-20364d907f8e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.476452 Aug 26 08:54:02.455885 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 136/270] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:01 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:02.479639 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-83b8a87f-9f09-4336-b2f4-ebaa53e8d20e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "POST /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/action" status: 202 len: 0 microversion: 2.20 time: 0.528574 Aug 26 08:54:02.482675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 135/271] 10.222.0.71 () {62 vars in 1319 bytes} [Fri Aug 26 08:54:01 2022] POST /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:54:02.497722 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-7e582223-3b27-484b-a25e-eba832038b83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:02.498836 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-7e582223-3b27-484b-a25e-eba832038b83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:02.517361 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7e582223-3b27-484b-a25e-eba832038b83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:02.518486 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7e582223-3b27-484b-a25e-eba832038b83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:02.519500 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7e582223-3b27-484b-a25e-eba832038b83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:02.520875 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7e582223-3b27-484b-a25e-eba832038b83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:02.521998 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7e582223-3b27-484b-a25e-eba832038b83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:02.522713 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7e582223-3b27-484b-a25e-eba832038b83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:02.713870 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4c9941a3-b695-4c90-8843-a8f2c7ae913d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:02.714705 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4c9941a3-b695-4c90-8843-a8f2c7ae913d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] [instance: 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:02.724451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c9941a3-b695-4c90-8843-a8f2c7ae913d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:02.725331 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c9941a3-b695-4c90-8843-a8f2c7ae913d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:02.725900 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c9941a3-b695-4c90-8843-a8f2c7ae913d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:02.726655 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c9941a3-b695-4c90-8843-a8f2c7ae913d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:02.727363 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c9941a3-b695-4c90-8843-a8f2c7ae913d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:02.727847 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c9941a3-b695-4c90-8843-a8f2c7ae913d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:02.747141 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-4c9941a3-b695-4c90-8843-a8f2c7ae913d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] HTTP exception thrown: Instance 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd could not be found. Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4c9941a3-b695-4c90-8843-a8f2c7ae913d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Request method failure captured: Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd HTTP/1.1 Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCInoso5AbVbcRplx90E7u7ghl33VnT3yrElmXU1j0N-vk5tctdTXSY5qnMwibrCQA19AOYVZqts-UqJeLneWyLvQtyR1QXemKw-IfT-_UJy-JqAt5WzEkCs4bwJjZzC8b23Rwl0CyeyW_CXXZpNnZwylXGOrn4A0OzSkAtbIVm7QinM Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 196b8882c5344c8380fecba536f39214 Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-VolumesActionsTest-1201923513 Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 08:54:02.749341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 08:54:02.750714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_196b8882c5344c8380fecba536f39214", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/196b8882c5344c8380fecba536f39214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/196b8882c5344c8380fecba536f39214"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/196b8882c5344c8380fecba536f39214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:54:02.750714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-VolumesActionsTest-1201923513 Aug 26 08:54:02.750714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 196b8882c5344c8380fecba536f39214 Aug 26 08:54:02.750714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-VolumesActionsTest-1201923513 Aug 26 08:54:02.750714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-VolumesActionsTest-1201923513-project Aug 26 08:54:02.750714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 08:54:02.750714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 08:54:02.750714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 230efbe75687494fa44777325c8acb4e Aug 26 08:54:02.750714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-VolumesActionsTest-1201923513-project Aug 26 08:54:02.750714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 08:54:02.750714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd could not be found. Aug 26 08:54:02.750714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': '6d8b7b79-29d0-4a40-9f13-94198c5d2fbd'} Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd could not be found. Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:54:02.751481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd could not be found. Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd could not be found. Aug 26 08:54:02.752604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:54:02.755705 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4c9941a3-b695-4c90-8843-a8f2c7ae913d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] Returning 404 to user: Instance 6d8b7b79-29d0-4a40-9f13-94198c5d2fbd could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:54:02.756750 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4c9941a3-b695-4c90-8843-a8f2c7ae913d tempest-VolumesActionsTest-1201923513 tempest-VolumesActionsTest-1201923513-project] 10.222.0.71 "GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd" status: 404 len: 111 microversion: 2.1 time: 0.047370 Aug 26 08:54:02.757449 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 136/272] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:02 2022] GET /compute/v2.1/servers/6d8b7b79-29d0-4a40-9f13-94198c5d2fbd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:54:02.761081 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7e582223-3b27-484b-a25e-eba832038b83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:02.772131 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7e582223-3b27-484b-a25e-eba832038b83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:02.773949 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7e582223-3b27-484b-a25e-eba832038b83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:02.775398 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-7e582223-3b27-484b-a25e-eba832038b83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.286469 Aug 26 08:54:02.776194 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 137/273] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:02 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:03.110469 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-076cea0d-e9cc-4878-b90e-c1b81f9319c3 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Action: 'create', calling method: .version_select at 0x7f136c1a7430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1673214775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBf86y0WKUuOES9JxBrt/X8O8U7e+pFHKdHPSJUSLt7cDck9g957zCDz+61LbcLgWNW7IkYtVFMn1GxfPB6aJtaU0irZkTppxSorwInK2R+pOAJdZxqvFZitjEipqM4ItQ=="}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:54:03.131380 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-076cea0d-e9cc-4878-b90e-c1b81f9319c3 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Getting quotas for project 37cc63bca9274f9ba58f8a92a499a36d. Resources: {'key_pairs'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:54:03.136154 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-076cea0d-e9cc-4878-b90e-c1b81f9319c3 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Getting quotas for user 229fe8f73e074ef89b1110da844268df and project 37cc63bca9274f9ba58f8a92a499a36d. Resources: {'key_pairs'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:54:03.182694 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-076cea0d-e9cc-4878-b90e-c1b81f9319c3 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.346881 Aug 26 08:54:03.184937 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 137/274] 10.222.0.71 () {60 vars in 1159 bytes} [Fri Aug 26 08:54:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:54:03.484380 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c78b8cf7-10f2-44ed-9417-62736a10f71a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:03.485441 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c78b8cf7-10f2-44ed-9417-62736a10f71a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:03.494709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c78b8cf7-10f2-44ed-9417-62736a10f71a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:03.495638 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c78b8cf7-10f2-44ed-9417-62736a10f71a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:03.496324 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c78b8cf7-10f2-44ed-9417-62736a10f71a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:03.497097 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c78b8cf7-10f2-44ed-9417-62736a10f71a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:03.497549 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c78b8cf7-10f2-44ed-9417-62736a10f71a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:03.497977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c78b8cf7-10f2-44ed-9417-62736a10f71a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:03.735383 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c78b8cf7-10f2-44ed-9417-62736a10f71a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:03.757082 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c78b8cf7-10f2-44ed-9417-62736a10f71a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.278685 Aug 26 08:54:03.760555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 138/275] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:03 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:03.813972 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-bbe874c3-8ee5-4d2b-8a66-1b9a758527bc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:03.815138 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-bbe874c3-8ee5-4d2b-8a66-1b9a758527bc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:03.825580 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bbe874c3-8ee5-4d2b-8a66-1b9a758527bc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:03.826672 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bbe874c3-8ee5-4d2b-8a66-1b9a758527bc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:03.828192 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bbe874c3-8ee5-4d2b-8a66-1b9a758527bc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:03.829956 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bbe874c3-8ee5-4d2b-8a66-1b9a758527bc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:03.831137 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bbe874c3-8ee5-4d2b-8a66-1b9a758527bc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:03.831938 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bbe874c3-8ee5-4d2b-8a66-1b9a758527bc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:04.003793 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-bbe874c3-8ee5-4d2b-8a66-1b9a758527bc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:04.013870 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-bbe874c3-8ee5-4d2b-8a66-1b9a758527bc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:04.015981 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-bbe874c3-8ee5-4d2b-8a66-1b9a758527bc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:04.017414 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-bbe874c3-8ee5-4d2b-8a66-1b9a758527bc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.219906 Aug 26 08:54:04.019995 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 138/276] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:03 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:04.784493 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0979663d-a199-477c-9434-1797a15454da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:04.784983 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-0979663d-a199-477c-9434-1797a15454da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:04.794172 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0979663d-a199-477c-9434-1797a15454da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:04.794172 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0979663d-a199-477c-9434-1797a15454da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:04.794909 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0979663d-a199-477c-9434-1797a15454da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:04.796069 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0979663d-a199-477c-9434-1797a15454da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:04.796992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0979663d-a199-477c-9434-1797a15454da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:04.797565 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0979663d-a199-477c-9434-1797a15454da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:05.048613 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0979663d-a199-477c-9434-1797a15454da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:05.050168 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a686e20a-548d-4b66-aca4-b6f610510a34 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:05.050974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a686e20a-548d-4b66-aca4-b6f610510a34 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:05.060085 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-0979663d-a199-477c-9434-1797a15454da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.280205 Aug 26 08:54:05.061333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 139/277] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:04 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:54:05.069577 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a686e20a-548d-4b66-aca4-b6f610510a34 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:05.070075 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a686e20a-548d-4b66-aca4-b6f610510a34 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:05.070678 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a686e20a-548d-4b66-aca4-b6f610510a34 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:05.071650 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a686e20a-548d-4b66-aca4-b6f610510a34 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:05.072099 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a686e20a-548d-4b66-aca4-b6f610510a34 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:05.072748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a686e20a-548d-4b66-aca4-b6f610510a34 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:05.247210 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a686e20a-548d-4b66-aca4-b6f610510a34 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:05.257822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a686e20a-548d-4b66-aca4-b6f610510a34 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:05.259322 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a686e20a-548d-4b66-aca4-b6f610510a34 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:05.260531 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a686e20a-548d-4b66-aca4-b6f610510a34 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.214634 Aug 26 08:54:05.261089 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 139/278] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:05 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:06.087263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4940155d-c417-4755-8e6a-104c3a83477b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:06.087886 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4940155d-c417-4755-8e6a-104c3a83477b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:06.094426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4940155d-c417-4755-8e6a-104c3a83477b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:06.094909 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4940155d-c417-4755-8e6a-104c3a83477b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:06.095368 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4940155d-c417-4755-8e6a-104c3a83477b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:06.096439 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4940155d-c417-4755-8e6a-104c3a83477b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:06.097154 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4940155d-c417-4755-8e6a-104c3a83477b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:06.097605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4940155d-c417-4755-8e6a-104c3a83477b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:06.241987 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-4940155d-c417-4755-8e6a-104c3a83477b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:06.252263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4940155d-c417-4755-8e6a-104c3a83477b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.169090 Aug 26 08:54:06.253315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 140/279] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:06 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:06.283561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-431899f2-3171-4576-aca2-3dfc509dc41b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:06.284163 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-431899f2-3171-4576-aca2-3dfc509dc41b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:06.296940 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-431899f2-3171-4576-aca2-3dfc509dc41b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:06.296940 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-431899f2-3171-4576-aca2-3dfc509dc41b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:06.296940 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-431899f2-3171-4576-aca2-3dfc509dc41b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:06.296940 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-431899f2-3171-4576-aca2-3dfc509dc41b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:06.297328 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-431899f2-3171-4576-aca2-3dfc509dc41b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:06.297328 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-431899f2-3171-4576-aca2-3dfc509dc41b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:06.455329 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-431899f2-3171-4576-aca2-3dfc509dc41b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:06.464928 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-431899f2-3171-4576-aca2-3dfc509dc41b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:06.467149 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-431899f2-3171-4576-aca2-3dfc509dc41b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:06.468561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-431899f2-3171-4576-aca2-3dfc509dc41b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.189169 Aug 26 08:54:06.469284 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 140/280] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:06 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:07.274367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-596c7ab5-8a8a-46a7-bfd1-343423b737c2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:07.274980 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-596c7ab5-8a8a-46a7-bfd1-343423b737c2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:07.283298 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-596c7ab5-8a8a-46a7-bfd1-343423b737c2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:07.284038 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-596c7ab5-8a8a-46a7-bfd1-343423b737c2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:07.284864 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-596c7ab5-8a8a-46a7-bfd1-343423b737c2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:07.285972 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-596c7ab5-8a8a-46a7-bfd1-343423b737c2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:07.286688 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-596c7ab5-8a8a-46a7-bfd1-343423b737c2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:07.287571 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-596c7ab5-8a8a-46a7-bfd1-343423b737c2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:07.478985 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-596c7ab5-8a8a-46a7-bfd1-343423b737c2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:07.494515 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b461e432-ac63-48de-8904-084f68720dc2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:07.495107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b461e432-ac63-48de-8904-084f68720dc2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:07.498108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-596c7ab5-8a8a-46a7-bfd1-343423b737c2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.227437 Aug 26 08:54:07.499380 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 141/281] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:07 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:07.502699 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b461e432-ac63-48de-8904-084f68720dc2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:07.503233 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b461e432-ac63-48de-8904-084f68720dc2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:07.503663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b461e432-ac63-48de-8904-084f68720dc2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:07.504360 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b461e432-ac63-48de-8904-084f68720dc2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:07.504805 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b461e432-ac63-48de-8904-084f68720dc2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:07.505221 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b461e432-ac63-48de-8904-084f68720dc2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:07.664318 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b461e432-ac63-48de-8904-084f68720dc2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:07.675647 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b461e432-ac63-48de-8904-084f68720dc2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:07.678185 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b461e432-ac63-48de-8904-084f68720dc2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:07.680216 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b461e432-ac63-48de-8904-084f68720dc2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.190236 Aug 26 08:54:07.680800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 141/282] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:07 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:08.523702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fae85b53-09ff-4e9c-a33f-9520b4548435 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:08.524557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-fae85b53-09ff-4e9c-a33f-9520b4548435 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:08.532333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fae85b53-09ff-4e9c-a33f-9520b4548435 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:08.533309 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fae85b53-09ff-4e9c-a33f-9520b4548435 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:08.533994 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fae85b53-09ff-4e9c-a33f-9520b4548435 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:08.535240 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fae85b53-09ff-4e9c-a33f-9520b4548435 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:08.535692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fae85b53-09ff-4e9c-a33f-9520b4548435 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:08.536446 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fae85b53-09ff-4e9c-a33f-9520b4548435 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:08.691001 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-fae85b53-09ff-4e9c-a33f-9520b4548435 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:08.700329 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fae85b53-09ff-4e9c-a33f-9520b4548435 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.183440 Aug 26 08:54:08.716208 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 142/283] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:08 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:08.721769 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e08d17c1-b941-489e-a8d4-cf3e1ee2158e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:08.722469 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e08d17c1-b941-489e-a8d4-cf3e1ee2158e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:08.732730 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e08d17c1-b941-489e-a8d4-cf3e1ee2158e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:08.733396 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e08d17c1-b941-489e-a8d4-cf3e1ee2158e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:08.734387 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e08d17c1-b941-489e-a8d4-cf3e1ee2158e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:08.735327 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e08d17c1-b941-489e-a8d4-cf3e1ee2158e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:08.735862 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e08d17c1-b941-489e-a8d4-cf3e1ee2158e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:08.736342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e08d17c1-b941-489e-a8d4-cf3e1ee2158e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:08.890980 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e08d17c1-b941-489e-a8d4-cf3e1ee2158e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:08.900321 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e08d17c1-b941-489e-a8d4-cf3e1ee2158e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:08.901945 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e08d17c1-b941-489e-a8d4-cf3e1ee2158e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:08.903185 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e08d17c1-b941-489e-a8d4-cf3e1ee2158e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.186964 Aug 26 08:54:08.903757 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 142/284] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:08 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:09.236968 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9227f33c-29ea-41c9-af85-e81784b7a7d2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:54:09.243853 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9227f33c-29ea-41c9-af85-e81784b7a7d2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:09.244354 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9227f33c-29ea-41c9-af85-e81784b7a7d2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:09.244810 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9227f33c-29ea-41c9-af85-e81784b7a7d2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:09.455306 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9227f33c-29ea-41c9-af85-e81784b7a7d2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Going to try to stop instance {{(pid=132217) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 08:54:09.516578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9227f33c-29ea-41c9-af85-e81784b7a7d2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "POST /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/action" status: 202 len: 0 microversion: 2.1 time: 0.283627 Aug 26 08:54:09.517318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 143/285] 10.222.0.71 () {60 vars in 1278 bytes} [Fri Aug 26 08:54:09 2022] POST /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:54:09.527873 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-92c693af-5978-4a84-a84c-884f14c7ae5a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:09.528783 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-92c693af-5978-4a84-a84c-884f14c7ae5a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:09.535559 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-92c693af-5978-4a84-a84c-884f14c7ae5a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:09.536036 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-92c693af-5978-4a84-a84c-884f14c7ae5a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:09.536636 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-92c693af-5978-4a84-a84c-884f14c7ae5a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:09.537339 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-92c693af-5978-4a84-a84c-884f14c7ae5a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:09.537813 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-92c693af-5978-4a84-a84c-884f14c7ae5a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:09.538193 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-92c693af-5978-4a84-a84c-884f14c7ae5a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:09.722868 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4e84b9b8-24a0-420f-b94b-5f92dc469b8c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:09.723689 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4e84b9b8-24a0-420f-b94b-5f92dc469b8c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:09.730646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4e84b9b8-24a0-420f-b94b-5f92dc469b8c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:09.731212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4e84b9b8-24a0-420f-b94b-5f92dc469b8c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:09.731715 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4e84b9b8-24a0-420f-b94b-5f92dc469b8c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:09.732755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4e84b9b8-24a0-420f-b94b-5f92dc469b8c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:09.733354 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4e84b9b8-24a0-420f-b94b-5f92dc469b8c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:09.733847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4e84b9b8-24a0-420f-b94b-5f92dc469b8c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:09.889588 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-4e84b9b8-24a0-420f-b94b-5f92dc469b8c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:09.897614 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4e84b9b8-24a0-420f-b94b-5f92dc469b8c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.179293 Aug 26 08:54:09.898167 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 144/286] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:09 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:09.926945 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-57f2355e-b33e-4729-90f7-4f336178b3a5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:09.927580 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-57f2355e-b33e-4729-90f7-4f336178b3a5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:09.934055 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57f2355e-b33e-4729-90f7-4f336178b3a5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:09.934470 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57f2355e-b33e-4729-90f7-4f336178b3a5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:09.934958 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57f2355e-b33e-4729-90f7-4f336178b3a5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:09.935715 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57f2355e-b33e-4729-90f7-4f336178b3a5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:09.936155 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57f2355e-b33e-4729-90f7-4f336178b3a5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:09.936595 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57f2355e-b33e-4729-90f7-4f336178b3a5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:09.940061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:09.952182 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-92c693af-5978-4a84-a84c-884f14c7ae5a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:09.965764 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-92c693af-5978-4a84-a84c-884f14c7ae5a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.442588 Aug 26 08:54:09.966584 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 143/287] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:09 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:10.104917 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-57f2355e-b33e-4729-90f7-4f336178b3a5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:10.114072 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-57f2355e-b33e-4729-90f7-4f336178b3a5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:10.115568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-57f2355e-b33e-4729-90f7-4f336178b3a5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:10.116736 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-57f2355e-b33e-4729-90f7-4f336178b3a5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.193923 Aug 26 08:54:10.117331 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 145/288] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:09 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:10.921466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4bd9d37c-0a81-43a0-9e5c-2b1bbb52a348 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:10.922287 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4bd9d37c-0a81-43a0-9e5c-2b1bbb52a348 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:10.930849 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4bd9d37c-0a81-43a0-9e5c-2b1bbb52a348 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:10.931384 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4bd9d37c-0a81-43a0-9e5c-2b1bbb52a348 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:10.931820 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4bd9d37c-0a81-43a0-9e5c-2b1bbb52a348 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:10.932558 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4bd9d37c-0a81-43a0-9e5c-2b1bbb52a348 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:10.932995 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4bd9d37c-0a81-43a0-9e5c-2b1bbb52a348 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:10.933432 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4bd9d37c-0a81-43a0-9e5c-2b1bbb52a348 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:10.989063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e470a24c-4c9a-4095-becf-d4e2755c156c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:10.989854 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e470a24c-4c9a-4095-becf-d4e2755c156c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:10.997556 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e470a24c-4c9a-4095-becf-d4e2755c156c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:10.999257 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e470a24c-4c9a-4095-becf-d4e2755c156c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:10.999257 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e470a24c-4c9a-4095-becf-d4e2755c156c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:11.000345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e470a24c-4c9a-4095-becf-d4e2755c156c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:11.000831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e470a24c-4c9a-4095-becf-d4e2755c156c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:11.001498 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e470a24c-4c9a-4095-becf-d4e2755c156c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:11.084959 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4bd9d37c-0a81-43a0-9e5c-2b1bbb52a348 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:11.087613 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:11.105682 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4bd9d37c-0a81-43a0-9e5c-2b1bbb52a348 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.188550 Aug 26 08:54:11.111037 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 144/289] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:10 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:11.146471 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-98314593-d3ac-49b4-a63e-158b53cb43c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:11.147110 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-98314593-d3ac-49b4-a63e-158b53cb43c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:11.155231 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-98314593-d3ac-49b4-a63e-158b53cb43c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:11.155717 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-98314593-d3ac-49b4-a63e-158b53cb43c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:11.156145 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-98314593-d3ac-49b4-a63e-158b53cb43c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:11.156847 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-98314593-d3ac-49b4-a63e-158b53cb43c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:11.157297 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-98314593-d3ac-49b4-a63e-158b53cb43c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:11.157722 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-98314593-d3ac-49b4-a63e-158b53cb43c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:11.174808 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e470a24c-4c9a-4095-becf-d4e2755c156c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:11.184147 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e470a24c-4c9a-4095-becf-d4e2755c156c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.199906 Aug 26 08:54:11.185133 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 146/290] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:10 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:11.309972 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-98314593-d3ac-49b4-a63e-158b53cb43c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:11.319023 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-98314593-d3ac-49b4-a63e-158b53cb43c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:11.320496 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-98314593-d3ac-49b4-a63e-158b53cb43c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:11.322349 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-98314593-d3ac-49b4-a63e-158b53cb43c8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.182433 Aug 26 08:54:11.322937 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 145/291] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:11 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:54:12.128703 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9a0a0947-4ccc-4c82-bb7d-67118106d3ec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:12.129384 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9a0a0947-4ccc-4c82-bb7d-67118106d3ec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:12.136166 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a0a0947-4ccc-4c82-bb7d-67118106d3ec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:12.136648 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a0a0947-4ccc-4c82-bb7d-67118106d3ec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:12.137072 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a0a0947-4ccc-4c82-bb7d-67118106d3ec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:12.137806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a0a0947-4ccc-4c82-bb7d-67118106d3ec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:12.138256 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a0a0947-4ccc-4c82-bb7d-67118106d3ec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:12.138667 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a0a0947-4ccc-4c82-bb7d-67118106d3ec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:12.205872 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a2f21761-ba19-46bf-87b2-75c67a6533d6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:12.206481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a2f21761-ba19-46bf-87b2-75c67a6533d6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:12.214009 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a2f21761-ba19-46bf-87b2-75c67a6533d6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:12.214532 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a2f21761-ba19-46bf-87b2-75c67a6533d6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:12.214998 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a2f21761-ba19-46bf-87b2-75c67a6533d6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:12.215709 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a2f21761-ba19-46bf-87b2-75c67a6533d6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:12.216175 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a2f21761-ba19-46bf-87b2-75c67a6533d6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:12.216602 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a2f21761-ba19-46bf-87b2-75c67a6533d6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:12.290202 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9a0a0947-4ccc-4c82-bb7d-67118106d3ec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:12.298598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9a0a0947-4ccc-4c82-bb7d-67118106d3ec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.174034 Aug 26 08:54:12.299566 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 147/292] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:12 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:12.345916 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-969818d0-40db-4321-9bcb-2cf246c1f2f4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:12.346790 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-969818d0-40db-4321-9bcb-2cf246c1f2f4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:12.356064 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-969818d0-40db-4321-9bcb-2cf246c1f2f4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:12.356561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-969818d0-40db-4321-9bcb-2cf246c1f2f4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:12.357322 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-969818d0-40db-4321-9bcb-2cf246c1f2f4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:12.358236 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-969818d0-40db-4321-9bcb-2cf246c1f2f4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:12.358689 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-969818d0-40db-4321-9bcb-2cf246c1f2f4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:12.359150 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-969818d0-40db-4321-9bcb-2cf246c1f2f4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:12.370038 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a2f21761-ba19-46bf-87b2-75c67a6533d6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:12.385638 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a2f21761-ba19-46bf-87b2-75c67a6533d6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.183717 Aug 26 08:54:12.386333 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 146/293] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:12 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:12.500394 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-969818d0-40db-4321-9bcb-2cf246c1f2f4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:12.508889 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-969818d0-40db-4321-9bcb-2cf246c1f2f4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:12.510325 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-969818d0-40db-4321-9bcb-2cf246c1f2f4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:12.511570 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-969818d0-40db-4321-9bcb-2cf246c1f2f4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.169863 Aug 26 08:54:12.512086 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 148/294] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:12 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:54:13.322804 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5589fa05-3d5b-4a95-afba-e127bd8a93f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:13.323624 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5589fa05-3d5b-4a95-afba-e127bd8a93f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:13.325670 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=4 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:13.332266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5589fa05-3d5b-4a95-afba-e127bd8a93f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:13.332751 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5589fa05-3d5b-4a95-afba-e127bd8a93f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:13.333183 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5589fa05-3d5b-4a95-afba-e127bd8a93f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:13.333896 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5589fa05-3d5b-4a95-afba-e127bd8a93f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:13.334350 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5589fa05-3d5b-4a95-afba-e127bd8a93f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:13.334774 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5589fa05-3d5b-4a95-afba-e127bd8a93f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:13.410312 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1c8e6f2a-5b55-4655-8ee7-14fc345c52c5 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:13.411797 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1c8e6f2a-5b55-4655-8ee7-14fc345c52c5 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:13.420413 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1c8e6f2a-5b55-4655-8ee7-14fc345c52c5 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:13.420914 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1c8e6f2a-5b55-4655-8ee7-14fc345c52c5 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:13.421366 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1c8e6f2a-5b55-4655-8ee7-14fc345c52c5 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:13.422115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1c8e6f2a-5b55-4655-8ee7-14fc345c52c5 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:13.423699 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1c8e6f2a-5b55-4655-8ee7-14fc345c52c5 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:13.424535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1c8e6f2a-5b55-4655-8ee7-14fc345c52c5 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:13.489471 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5589fa05-3d5b-4a95-afba-e127bd8a93f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:13.498298 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5589fa05-3d5b-4a95-afba-e127bd8a93f7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.180299 Aug 26 08:54:13.499008 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 147/295] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:13 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:13.535699 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-058b7838-8669-4625-8a17-85bd733ca03d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:13.536392 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-058b7838-8669-4625-8a17-85bd733ca03d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:13.544279 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-058b7838-8669-4625-8a17-85bd733ca03d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:13.545024 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-058b7838-8669-4625-8a17-85bd733ca03d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:13.545282 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-058b7838-8669-4625-8a17-85bd733ca03d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:13.546021 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-058b7838-8669-4625-8a17-85bd733ca03d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:13.546589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-058b7838-8669-4625-8a17-85bd733ca03d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:13.547043 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-058b7838-8669-4625-8a17-85bd733ca03d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:13.579927 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1c8e6f2a-5b55-4655-8ee7-14fc345c52c5 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:13.588479 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1c8e6f2a-5b55-4655-8ee7-14fc345c52c5 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.184090 Aug 26 08:54:13.589059 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 149/296] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:13 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:13.691341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-058b7838-8669-4625-8a17-85bd733ca03d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:13.700213 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-058b7838-8669-4625-8a17-85bd733ca03d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:13.701670 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-058b7838-8669-4625-8a17-85bd733ca03d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:13.702838 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-058b7838-8669-4625-8a17-85bd733ca03d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.171151 Aug 26 08:54:13.703452 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 148/297] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:13 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:54:14.520202 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d4056083-dbbe-4c83-a4f0-87dd15f59463 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:14.520805 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d4056083-dbbe-4c83-a4f0-87dd15f59463 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:14.527186 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d4056083-dbbe-4c83-a4f0-87dd15f59463 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:14.527681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d4056083-dbbe-4c83-a4f0-87dd15f59463 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:14.528257 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d4056083-dbbe-4c83-a4f0-87dd15f59463 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:14.528972 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d4056083-dbbe-4c83-a4f0-87dd15f59463 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:14.529479 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d4056083-dbbe-4c83-a4f0-87dd15f59463 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:14.529838 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d4056083-dbbe-4c83-a4f0-87dd15f59463 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:14.613922 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d7c977c5-8c8d-4e61-9139-c3c6b81de2f8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:14.614872 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d7c977c5-8c8d-4e61-9139-c3c6b81de2f8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:14.626998 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7c977c5-8c8d-4e61-9139-c3c6b81de2f8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:14.627485 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7c977c5-8c8d-4e61-9139-c3c6b81de2f8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:14.628254 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7c977c5-8c8d-4e61-9139-c3c6b81de2f8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:14.629399 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7c977c5-8c8d-4e61-9139-c3c6b81de2f8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:14.629916 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7c977c5-8c8d-4e61-9139-c3c6b81de2f8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:14.630430 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7c977c5-8c8d-4e61-9139-c3c6b81de2f8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:14.691058 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d4056083-dbbe-4c83-a4f0-87dd15f59463 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:14.700241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d4056083-dbbe-4c83-a4f0-87dd15f59463 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.183834 Aug 26 08:54:14.701267 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 150/298] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:14 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:14.728340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-aed5b841-43b7-4697-9b9e-497154298788 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:14.728966 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-aed5b841-43b7-4697-9b9e-497154298788 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:14.738296 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aed5b841-43b7-4697-9b9e-497154298788 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:14.739151 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aed5b841-43b7-4697-9b9e-497154298788 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:14.739576 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aed5b841-43b7-4697-9b9e-497154298788 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:14.740770 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aed5b841-43b7-4697-9b9e-497154298788 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:14.741251 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aed5b841-43b7-4697-9b9e-497154298788 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:14.741616 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aed5b841-43b7-4697-9b9e-497154298788 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:14.801891 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d7c977c5-8c8d-4e61-9139-c3c6b81de2f8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:14.810916 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d7c977c5-8c8d-4e61-9139-c3c6b81de2f8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.203802 Aug 26 08:54:14.811539 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 149/299] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:14 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:14.897186 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-aed5b841-43b7-4697-9b9e-497154298788 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:14.906187 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-aed5b841-43b7-4697-9b9e-497154298788 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:14.907708 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-aed5b841-43b7-4697-9b9e-497154298788 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:14.908950 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-aed5b841-43b7-4697-9b9e-497154298788 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.185399 Aug 26 08:54:14.909533 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 151/300] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:14 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:15.722496 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e3479128-f503-4235-aeda-2b7ff84214fd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:15.723305 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e3479128-f503-4235-aeda-2b7ff84214fd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:15.730803 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e3479128-f503-4235-aeda-2b7ff84214fd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:15.731329 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e3479128-f503-4235-aeda-2b7ff84214fd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:15.731745 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e3479128-f503-4235-aeda-2b7ff84214fd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:15.732450 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e3479128-f503-4235-aeda-2b7ff84214fd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:15.732893 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e3479128-f503-4235-aeda-2b7ff84214fd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:15.733320 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e3479128-f503-4235-aeda-2b7ff84214fd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:15.837284 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1976ac9d-f682-4378-b646-5058bf34a7f3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:15.838075 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1976ac9d-f682-4378-b646-5058bf34a7f3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:15.844839 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1976ac9d-f682-4378-b646-5058bf34a7f3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:15.845471 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1976ac9d-f682-4378-b646-5058bf34a7f3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:15.846325 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1976ac9d-f682-4378-b646-5058bf34a7f3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:15.847142 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1976ac9d-f682-4378-b646-5058bf34a7f3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:15.847805 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1976ac9d-f682-4378-b646-5058bf34a7f3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:15.848512 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1976ac9d-f682-4378-b646-5058bf34a7f3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:15.893339 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e3479128-f503-4235-aeda-2b7ff84214fd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:15.901448 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e3479128-f503-4235-aeda-2b7ff84214fd tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.183294 Aug 26 08:54:15.902185 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 150/301] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:15 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:15.935561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d5ca831d-a343-466c-baae-5a64f86f7da1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:15.936164 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d5ca831d-a343-466c-baae-5a64f86f7da1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:15.942687 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d5ca831d-a343-466c-baae-5a64f86f7da1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:15.943233 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d5ca831d-a343-466c-baae-5a64f86f7da1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:15.943666 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d5ca831d-a343-466c-baae-5a64f86f7da1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:15.944366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d5ca831d-a343-466c-baae-5a64f86f7da1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:15.944817 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d5ca831d-a343-466c-baae-5a64f86f7da1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:15.945232 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d5ca831d-a343-466c-baae-5a64f86f7da1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:15.992142 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1976ac9d-f682-4378-b646-5058bf34a7f3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:16.000922 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1976ac9d-f682-4378-b646-5058bf34a7f3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.167446 Aug 26 08:54:16.001515 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 152/302] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:15 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:54:16.089799 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d5ca831d-a343-466c-baae-5a64f86f7da1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:16.099495 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d5ca831d-a343-466c-baae-5a64f86f7da1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:16.100935 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d5ca831d-a343-466c-baae-5a64f86f7da1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:16.102094 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d5ca831d-a343-466c-baae-5a64f86f7da1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.170550 Aug 26 08:54:16.102663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 151/303] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:15 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:54:16.925477 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-7c44caaa-16d6-4874-9dac-64783c7b560b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:16.926075 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-7c44caaa-16d6-4874-9dac-64783c7b560b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:16.932572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7c44caaa-16d6-4874-9dac-64783c7b560b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:16.933094 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7c44caaa-16d6-4874-9dac-64783c7b560b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:16.933526 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7c44caaa-16d6-4874-9dac-64783c7b560b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:16.934220 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7c44caaa-16d6-4874-9dac-64783c7b560b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:16.934669 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7c44caaa-16d6-4874-9dac-64783c7b560b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:16.935353 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7c44caaa-16d6-4874-9dac-64783c7b560b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:17.024591 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ff892c19-7c8e-46b7-9fd4-353cd2a5b83c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:17.025306 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ff892c19-7c8e-46b7-9fd4-353cd2a5b83c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:17.027809 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:17.033662 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ff892c19-7c8e-46b7-9fd4-353cd2a5b83c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:17.034172 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ff892c19-7c8e-46b7-9fd4-353cd2a5b83c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:17.034602 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ff892c19-7c8e-46b7-9fd4-353cd2a5b83c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:17.035388 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ff892c19-7c8e-46b7-9fd4-353cd2a5b83c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:17.035839 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ff892c19-7c8e-46b7-9fd4-353cd2a5b83c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:17.036344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ff892c19-7c8e-46b7-9fd4-353cd2a5b83c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:17.075543 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7c44caaa-16d6-4874-9dac-64783c7b560b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:17.083872 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-7c44caaa-16d6-4874-9dac-64783c7b560b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.162235 Aug 26 08:54:17.084577 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 153/304] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:16 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:17.126073 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-eab86dcf-2d0b-4ea5-a9a1-fec204ea12d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:17.126691 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-eab86dcf-2d0b-4ea5-a9a1-fec204ea12d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:17.133315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eab86dcf-2d0b-4ea5-a9a1-fec204ea12d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:17.133801 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eab86dcf-2d0b-4ea5-a9a1-fec204ea12d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:17.134303 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eab86dcf-2d0b-4ea5-a9a1-fec204ea12d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:17.134997 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eab86dcf-2d0b-4ea5-a9a1-fec204ea12d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:17.135482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eab86dcf-2d0b-4ea5-a9a1-fec204ea12d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:17.135895 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eab86dcf-2d0b-4ea5-a9a1-fec204ea12d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:17.181872 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ff892c19-7c8e-46b7-9fd4-353cd2a5b83c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:17.191720 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ff892c19-7c8e-46b7-9fd4-353cd2a5b83c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.171186 Aug 26 08:54:17.192293 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 152/305] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:17 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:17.294247 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-eab86dcf-2d0b-4ea5-a9a1-fec204ea12d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:17.302941 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-eab86dcf-2d0b-4ea5-a9a1-fec204ea12d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:17.304363 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-eab86dcf-2d0b-4ea5-a9a1-fec204ea12d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:17.305512 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-eab86dcf-2d0b-4ea5-a9a1-fec204ea12d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.183695 Aug 26 08:54:17.306094 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 154/306] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:17 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:54:18.106221 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-fd5d04b6-66bd-43cf-986d-8d6090904630 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:18.106838 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-fd5d04b6-66bd-43cf-986d-8d6090904630 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:18.114836 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd5d04b6-66bd-43cf-986d-8d6090904630 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:18.114836 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd5d04b6-66bd-43cf-986d-8d6090904630 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:18.115182 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd5d04b6-66bd-43cf-986d-8d6090904630 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:18.115780 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd5d04b6-66bd-43cf-986d-8d6090904630 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:18.116245 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd5d04b6-66bd-43cf-986d-8d6090904630 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:18.116660 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd5d04b6-66bd-43cf-986d-8d6090904630 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:18.216873 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-764e838a-d757-4ee9-baeb-197266376396 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:18.217498 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-764e838a-d757-4ee9-baeb-197266376396 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:18.225383 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-764e838a-d757-4ee9-baeb-197266376396 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:18.230535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-764e838a-d757-4ee9-baeb-197266376396 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:18.230535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-764e838a-d757-4ee9-baeb-197266376396 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:18.230535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-764e838a-d757-4ee9-baeb-197266376396 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:18.230535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-764e838a-d757-4ee9-baeb-197266376396 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:18.231229 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-764e838a-d757-4ee9-baeb-197266376396 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:18.262220 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-fd5d04b6-66bd-43cf-986d-8d6090904630 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:18.270942 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-fd5d04b6-66bd-43cf-986d-8d6090904630 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.168555 Aug 26 08:54:18.271556 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 153/307] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:18 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:18.329810 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-03a2dc79-97a4-4c5d-b85f-d7a0711a46d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:18.330461 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-03a2dc79-97a4-4c5d-b85f-d7a0711a46d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:18.338510 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-03a2dc79-97a4-4c5d-b85f-d7a0711a46d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:18.339039 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-03a2dc79-97a4-4c5d-b85f-d7a0711a46d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:18.339478 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-03a2dc79-97a4-4c5d-b85f-d7a0711a46d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:18.340195 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-03a2dc79-97a4-4c5d-b85f-d7a0711a46d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:18.340740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-03a2dc79-97a4-4c5d-b85f-d7a0711a46d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:18.341147 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-03a2dc79-97a4-4c5d-b85f-d7a0711a46d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:18.381201 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-764e838a-d757-4ee9-baeb-197266376396 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:18.390044 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-764e838a-d757-4ee9-baeb-197266376396 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.179258 Aug 26 08:54:18.390742 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 155/308] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:18 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:18.496056 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-03a2dc79-97a4-4c5d-b85f-d7a0711a46d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:18.504831 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-03a2dc79-97a4-4c5d-b85f-d7a0711a46d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:18.506259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-03a2dc79-97a4-4c5d-b85f-d7a0711a46d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:18.507454 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-03a2dc79-97a4-4c5d-b85f-d7a0711a46d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.181659 Aug 26 08:54:18.508025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 154/309] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:18 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:19.292506 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ecc161f2-fc0f-4b5c-bdce-7827fa3babb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:19.293115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ecc161f2-fc0f-4b5c-bdce-7827fa3babb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:19.299605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ecc161f2-fc0f-4b5c-bdce-7827fa3babb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:19.300096 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ecc161f2-fc0f-4b5c-bdce-7827fa3babb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:19.300528 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ecc161f2-fc0f-4b5c-bdce-7827fa3babb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:19.301226 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ecc161f2-fc0f-4b5c-bdce-7827fa3babb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:19.301687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ecc161f2-fc0f-4b5c-bdce-7827fa3babb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:19.302112 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ecc161f2-fc0f-4b5c-bdce-7827fa3babb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:19.412179 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3e7837e0-396d-4a2d-a8f6-033b583f8a91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:19.413097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3e7837e0-396d-4a2d-a8f6-033b583f8a91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:19.419916 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3e7837e0-396d-4a2d-a8f6-033b583f8a91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:19.420496 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3e7837e0-396d-4a2d-a8f6-033b583f8a91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:19.420925 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3e7837e0-396d-4a2d-a8f6-033b583f8a91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:19.421634 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3e7837e0-396d-4a2d-a8f6-033b583f8a91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:19.422066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3e7837e0-396d-4a2d-a8f6-033b583f8a91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:19.422481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3e7837e0-396d-4a2d-a8f6-033b583f8a91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:19.454804 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ecc161f2-fc0f-4b5c-bdce-7827fa3babb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:19.465007 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ecc161f2-fc0f-4b5c-bdce-7827fa3babb8 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.176394 Aug 26 08:54:19.465620 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 156/310] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:19 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:19.531697 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3ab08cc3-b266-45ac-8eed-c3c8bb35ca92 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:19.532545 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3ab08cc3-b266-45ac-8eed-c3c8bb35ca92 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:19.539482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ab08cc3-b266-45ac-8eed-c3c8bb35ca92 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:19.539974 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ab08cc3-b266-45ac-8eed-c3c8bb35ca92 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:19.540599 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ab08cc3-b266-45ac-8eed-c3c8bb35ca92 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:19.541323 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ab08cc3-b266-45ac-8eed-c3c8bb35ca92 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:19.541772 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ab08cc3-b266-45ac-8eed-c3c8bb35ca92 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:19.542189 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ab08cc3-b266-45ac-8eed-c3c8bb35ca92 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:19.581221 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3e7837e0-396d-4a2d-a8f6-033b583f8a91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:19.590731 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3e7837e0-396d-4a2d-a8f6-033b583f8a91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.182795 Aug 26 08:54:19.591549 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 155/311] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:19 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:19.681339 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3ab08cc3-b266-45ac-8eed-c3c8bb35ca92 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:19.692370 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3ab08cc3-b266-45ac-8eed-c3c8bb35ca92 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:19.694188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3ab08cc3-b266-45ac-8eed-c3c8bb35ca92 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:19.696160 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-3ab08cc3-b266-45ac-8eed-c3c8bb35ca92 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.168995 Aug 26 08:54:19.696997 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 157/312] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:19 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:20.487315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f912321a-886a-4a5f-95c6-1f56d16833bb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:20.488241 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f912321a-886a-4a5f-95c6-1f56d16833bb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:20.498359 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f912321a-886a-4a5f-95c6-1f56d16833bb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:20.499054 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f912321a-886a-4a5f-95c6-1f56d16833bb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:20.499653 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f912321a-886a-4a5f-95c6-1f56d16833bb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:20.500755 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f912321a-886a-4a5f-95c6-1f56d16833bb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:20.501244 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f912321a-886a-4a5f-95c6-1f56d16833bb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:20.501741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f912321a-886a-4a5f-95c6-1f56d16833bb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:20.617360 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-68a6f20b-49d1-4d75-9f3a-29e2b821663f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:20.618377 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-68a6f20b-49d1-4d75-9f3a-29e2b821663f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:20.625178 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-68a6f20b-49d1-4d75-9f3a-29e2b821663f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:20.625674 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-68a6f20b-49d1-4d75-9f3a-29e2b821663f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:20.626144 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-68a6f20b-49d1-4d75-9f3a-29e2b821663f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:20.626831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-68a6f20b-49d1-4d75-9f3a-29e2b821663f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:20.627308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-68a6f20b-49d1-4d75-9f3a-29e2b821663f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:20.627804 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-68a6f20b-49d1-4d75-9f3a-29e2b821663f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:20.681822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f912321a-886a-4a5f-95c6-1f56d16833bb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:20.690814 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f912321a-886a-4a5f-95c6-1f56d16833bb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.208144 Aug 26 08:54:20.691447 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 156/313] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:20 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:20.720221 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-975fd23a-2f95-43af-9655-8a639048e46a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:20.721081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-975fd23a-2f95-43af-9655-8a639048e46a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:20.727682 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-975fd23a-2f95-43af-9655-8a639048e46a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:20.728329 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-975fd23a-2f95-43af-9655-8a639048e46a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:20.728773 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-975fd23a-2f95-43af-9655-8a639048e46a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:20.729476 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-975fd23a-2f95-43af-9655-8a639048e46a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:20.729918 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-975fd23a-2f95-43af-9655-8a639048e46a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:20.730383 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-975fd23a-2f95-43af-9655-8a639048e46a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:20.794694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-68a6f20b-49d1-4d75-9f3a-29e2b821663f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:20.804244 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-68a6f20b-49d1-4d75-9f3a-29e2b821663f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.191601 Aug 26 08:54:20.805455 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 158/314] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:20 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:20.885661 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-975fd23a-2f95-43af-9655-8a639048e46a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:20.894183 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-975fd23a-2f95-43af-9655-8a639048e46a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:20.895631 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-975fd23a-2f95-43af-9655-8a639048e46a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:20.896807 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-975fd23a-2f95-43af-9655-8a639048e46a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.181408 Aug 26 08:54:20.897438 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 157/315] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:20 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:54:21.712837 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-72bfd09b-5240-4731-9696-a1cb72e959f6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:21.713622 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-72bfd09b-5240-4731-9696-a1cb72e959f6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:21.721250 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-72bfd09b-5240-4731-9696-a1cb72e959f6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:21.722002 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-72bfd09b-5240-4731-9696-a1cb72e959f6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:21.722571 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-72bfd09b-5240-4731-9696-a1cb72e959f6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:21.723792 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-72bfd09b-5240-4731-9696-a1cb72e959f6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:21.724343 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-72bfd09b-5240-4731-9696-a1cb72e959f6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:21.724759 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-72bfd09b-5240-4731-9696-a1cb72e959f6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:21.826319 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-cf07669c-75b6-41e7-ae65-dc84ff8cb35a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:21.827246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-cf07669c-75b6-41e7-ae65-dc84ff8cb35a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:21.837507 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cf07669c-75b6-41e7-ae65-dc84ff8cb35a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:21.838073 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cf07669c-75b6-41e7-ae65-dc84ff8cb35a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:21.838747 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cf07669c-75b6-41e7-ae65-dc84ff8cb35a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:21.840400 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cf07669c-75b6-41e7-ae65-dc84ff8cb35a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:21.841172 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cf07669c-75b6-41e7-ae65-dc84ff8cb35a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:21.841981 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cf07669c-75b6-41e7-ae65-dc84ff8cb35a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:21.888550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-72bfd09b-5240-4731-9696-a1cb72e959f6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:21.897454 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-72bfd09b-5240-4731-9696-a1cb72e959f6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.188624 Aug 26 08:54:21.898416 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 159/316] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:21 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:21.929476 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b9c69832-db05-4d88-b829-01c06b12c35e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:21.930295 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b9c69832-db05-4d88-b829-01c06b12c35e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:21.938130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9c69832-db05-4d88-b829-01c06b12c35e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:21.938626 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9c69832-db05-4d88-b829-01c06b12c35e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:21.939093 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9c69832-db05-4d88-b829-01c06b12c35e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:21.939806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9c69832-db05-4d88-b829-01c06b12c35e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:21.940251 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9c69832-db05-4d88-b829-01c06b12c35e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:21.940724 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9c69832-db05-4d88-b829-01c06b12c35e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:22.005982 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-cf07669c-75b6-41e7-ae65-dc84ff8cb35a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:22.016069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-cf07669c-75b6-41e7-ae65-dc84ff8cb35a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.193690 Aug 26 08:54:22.016664 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 158/317] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:21 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:54:22.087752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b9c69832-db05-4d88-b829-01c06b12c35e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:22.097264 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b9c69832-db05-4d88-b829-01c06b12c35e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:22.098685 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b9c69832-db05-4d88-b829-01c06b12c35e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:22.099923 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b9c69832-db05-4d88-b829-01c06b12c35e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.174380 Aug 26 08:54:22.100497 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 160/318] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:21 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:22.919304 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d8e18cb4-e1b2-466d-a3c5-716c77be9243 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:22.919950 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d8e18cb4-e1b2-466d-a3c5-716c77be9243 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:22.927130 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d8e18cb4-e1b2-466d-a3c5-716c77be9243 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:22.927641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d8e18cb4-e1b2-466d-a3c5-716c77be9243 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:22.928077 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d8e18cb4-e1b2-466d-a3c5-716c77be9243 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:22.928799 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d8e18cb4-e1b2-466d-a3c5-716c77be9243 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:22.929257 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d8e18cb4-e1b2-466d-a3c5-716c77be9243 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:22.929680 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d8e18cb4-e1b2-466d-a3c5-716c77be9243 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:23.044502 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2d41c7fc-ff3c-487f-b260-754c0228a8dc tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:23.045308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2d41c7fc-ff3c-487f-b260-754c0228a8dc tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:23.051502 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2d41c7fc-ff3c-487f-b260-754c0228a8dc tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:23.051993 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2d41c7fc-ff3c-487f-b260-754c0228a8dc tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:23.052417 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2d41c7fc-ff3c-487f-b260-754c0228a8dc tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:23.053108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2d41c7fc-ff3c-487f-b260-754c0228a8dc tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:23.053548 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2d41c7fc-ff3c-487f-b260-754c0228a8dc tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:23.053962 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2d41c7fc-ff3c-487f-b260-754c0228a8dc tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:23.074719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d8e18cb4-e1b2-466d-a3c5-716c77be9243 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:23.082880 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d8e18cb4-e1b2-466d-a3c5-716c77be9243 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.167616 Aug 26 08:54:23.083507 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 159/319] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:22 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:23.123641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a42e6057-deeb-4ff5-a58c-7d41ed6f71a3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:23.124350 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a42e6057-deeb-4ff5-a58c-7d41ed6f71a3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:23.132390 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a42e6057-deeb-4ff5-a58c-7d41ed6f71a3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:23.132837 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a42e6057-deeb-4ff5-a58c-7d41ed6f71a3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:23.133487 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a42e6057-deeb-4ff5-a58c-7d41ed6f71a3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:23.134479 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a42e6057-deeb-4ff5-a58c-7d41ed6f71a3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:23.135197 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a42e6057-deeb-4ff5-a58c-7d41ed6f71a3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:23.135664 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a42e6057-deeb-4ff5-a58c-7d41ed6f71a3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:23.213348 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2d41c7fc-ff3c-487f-b260-754c0228a8dc tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:23.216936 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=100 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:23.223223 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2d41c7fc-ff3c-487f-b260-754c0228a8dc tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.182837 Aug 26 08:54:23.223957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 161/320] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:23 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:23.297950 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a42e6057-deeb-4ff5-a58c-7d41ed6f71a3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:23.306376 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a42e6057-deeb-4ff5-a58c-7d41ed6f71a3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:23.307822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a42e6057-deeb-4ff5-a58c-7d41ed6f71a3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:23.308980 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a42e6057-deeb-4ff5-a58c-7d41ed6f71a3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.189482 Aug 26 08:54:23.309549 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 160/321] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:23 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:54:24.105794 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a963f8cd-76ff-43cf-b787-837cd05801ad tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:24.106656 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a963f8cd-76ff-43cf-b787-837cd05801ad tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:24.113546 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a963f8cd-76ff-43cf-b787-837cd05801ad tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:24.114047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a963f8cd-76ff-43cf-b787-837cd05801ad tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:24.114477 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a963f8cd-76ff-43cf-b787-837cd05801ad tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:24.115247 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a963f8cd-76ff-43cf-b787-837cd05801ad tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:24.115696 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a963f8cd-76ff-43cf-b787-837cd05801ad tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:24.116119 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a963f8cd-76ff-43cf-b787-837cd05801ad tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:24.244826 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-12e970a5-8681-48ab-9daa-9f6d96ad3c31 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:24.245765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-12e970a5-8681-48ab-9daa-9f6d96ad3c31 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:24.253132 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-12e970a5-8681-48ab-9daa-9f6d96ad3c31 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:24.253630 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-12e970a5-8681-48ab-9daa-9f6d96ad3c31 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:24.254055 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-12e970a5-8681-48ab-9daa-9f6d96ad3c31 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:24.254748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-12e970a5-8681-48ab-9daa-9f6d96ad3c31 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:24.255232 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-12e970a5-8681-48ab-9daa-9f6d96ad3c31 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:24.258584 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a963f8cd-76ff-43cf-b787-837cd05801ad tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:24.261207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-12e970a5-8681-48ab-9daa-9f6d96ad3c31 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:24.266637 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a963f8cd-76ff-43cf-b787-837cd05801ad tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.165394 Aug 26 08:54:24.267197 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 162/322] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:24 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:24.277440 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=100 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:24.333687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-100690bc-9ec1-4232-ab7f-1ac2d2525394 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:24.334318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-100690bc-9ec1-4232-ab7f-1ac2d2525394 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:24.337856 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=72 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:24.341714 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-100690bc-9ec1-4232-ab7f-1ac2d2525394 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:24.342175 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-100690bc-9ec1-4232-ab7f-1ac2d2525394 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:24.342601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-100690bc-9ec1-4232-ab7f-1ac2d2525394 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:24.343333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-100690bc-9ec1-4232-ab7f-1ac2d2525394 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:24.343786 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-100690bc-9ec1-4232-ab7f-1ac2d2525394 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:24.344203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-100690bc-9ec1-4232-ab7f-1ac2d2525394 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:24.407465 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-12e970a5-8681-48ab-9daa-9f6d96ad3c31 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:24.416344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-12e970a5-8681-48ab-9daa-9f6d96ad3c31 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.175905 Aug 26 08:54:24.416930 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 161/323] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:24 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:24.494449 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-100690bc-9ec1-4232-ab7f-1ac2d2525394 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:24.503679 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-100690bc-9ec1-4232-ab7f-1ac2d2525394 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:24.505127 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-100690bc-9ec1-4232-ab7f-1ac2d2525394 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:24.506312 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-100690bc-9ec1-4232-ab7f-1ac2d2525394 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.176914 Aug 26 08:54:24.506915 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 163/324] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:24 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:25.287612 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-482a1165-70cb-4cd9-8fb2-a8739186f57f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:25.288391 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-482a1165-70cb-4cd9-8fb2-a8739186f57f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:25.295316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-482a1165-70cb-4cd9-8fb2-a8739186f57f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:25.295813 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-482a1165-70cb-4cd9-8fb2-a8739186f57f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:25.296230 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-482a1165-70cb-4cd9-8fb2-a8739186f57f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:25.296927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-482a1165-70cb-4cd9-8fb2-a8739186f57f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:25.297378 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-482a1165-70cb-4cd9-8fb2-a8739186f57f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:25.297791 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-482a1165-70cb-4cd9-8fb2-a8739186f57f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:25.437890 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e262e248-c8a8-4679-8cee-af654b064d99 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:25.438485 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e262e248-c8a8-4679-8cee-af654b064d99 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:25.445283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e262e248-c8a8-4679-8cee-af654b064d99 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:25.445796 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e262e248-c8a8-4679-8cee-af654b064d99 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:25.446219 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e262e248-c8a8-4679-8cee-af654b064d99 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:25.446936 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e262e248-c8a8-4679-8cee-af654b064d99 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:25.447389 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e262e248-c8a8-4679-8cee-af654b064d99 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:25.447885 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e262e248-c8a8-4679-8cee-af654b064d99 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:25.463378 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-482a1165-70cb-4cd9-8fb2-a8739186f57f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:25.471278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-482a1165-70cb-4cd9-8fb2-a8739186f57f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.187577 Aug 26 08:54:25.471864 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 162/325] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:25 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:25.532085 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b1856941-95aa-4395-a8bc-cf1950080929 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:25.532698 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b1856941-95aa-4395-a8bc-cf1950080929 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:25.544538 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b1856941-95aa-4395-a8bc-cf1950080929 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:25.545366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b1856941-95aa-4395-a8bc-cf1950080929 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:25.546734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b1856941-95aa-4395-a8bc-cf1950080929 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:25.550710 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b1856941-95aa-4395-a8bc-cf1950080929 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:25.553320 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b1856941-95aa-4395-a8bc-cf1950080929 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:25.555961 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b1856941-95aa-4395-a8bc-cf1950080929 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:25.608261 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e262e248-c8a8-4679-8cee-af654b064d99 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:25.619007 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e262e248-c8a8-4679-8cee-af654b064d99 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.184359 Aug 26 08:54:25.620049 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 164/326] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:25 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:25.713006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b1856941-95aa-4395-a8bc-cf1950080929 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:25.723583 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b1856941-95aa-4395-a8bc-cf1950080929 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:25.724996 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b1856941-95aa-4395-a8bc-cf1950080929 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:25.726151 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b1856941-95aa-4395-a8bc-cf1950080929 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.199925 Aug 26 08:54:25.726712 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 163/327] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:25 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:26.496015 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-bbed9c30-0dc2-4a53-93dd-f321538b80e3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:26.497120 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-bbed9c30-0dc2-4a53-93dd-f321538b80e3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:26.505778 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bbed9c30-0dc2-4a53-93dd-f321538b80e3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:26.506773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bbed9c30-0dc2-4a53-93dd-f321538b80e3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:26.507559 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bbed9c30-0dc2-4a53-93dd-f321538b80e3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:26.508798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bbed9c30-0dc2-4a53-93dd-f321538b80e3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:26.509517 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bbed9c30-0dc2-4a53-93dd-f321538b80e3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:26.509958 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bbed9c30-0dc2-4a53-93dd-f321538b80e3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:26.644884 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-dbf699fa-bdae-4bb0-b9b5-ea696e23653d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:26.645733 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-dbf699fa-bdae-4bb0-b9b5-ea696e23653d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:26.652646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dbf699fa-bdae-4bb0-b9b5-ea696e23653d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:26.653120 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dbf699fa-bdae-4bb0-b9b5-ea696e23653d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:26.653545 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dbf699fa-bdae-4bb0-b9b5-ea696e23653d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:26.654237 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dbf699fa-bdae-4bb0-b9b5-ea696e23653d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:26.654346 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bbed9c30-0dc2-4a53-93dd-f321538b80e3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:26.654682 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dbf699fa-bdae-4bb0-b9b5-ea696e23653d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:26.655138 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dbf699fa-bdae-4bb0-b9b5-ea696e23653d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:26.663309 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-bbed9c30-0dc2-4a53-93dd-f321538b80e3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.173089 Aug 26 08:54:26.663814 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 165/328] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:26 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:26.749792 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-bc92fbf6-11b4-402b-bf15-d621a58efaee tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:26.750400 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-bc92fbf6-11b4-402b-bf15-d621a58efaee tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:26.756599 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc92fbf6-11b4-402b-bf15-d621a58efaee tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:26.757090 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc92fbf6-11b4-402b-bf15-d621a58efaee tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:26.757521 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc92fbf6-11b4-402b-bf15-d621a58efaee tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:26.758241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc92fbf6-11b4-402b-bf15-d621a58efaee tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:26.758667 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc92fbf6-11b4-402b-bf15-d621a58efaee tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:26.759115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc92fbf6-11b4-402b-bf15-d621a58efaee tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:26.804207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-dbf699fa-bdae-4bb0-b9b5-ea696e23653d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:26.817036 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-dbf699fa-bdae-4bb0-b9b5-ea696e23653d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.174224 Aug 26 08:54:26.817036 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 164/329] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:26 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:26.906993 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bc92fbf6-11b4-402b-bf15-d621a58efaee tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:26.918388 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bc92fbf6-11b4-402b-bf15-d621a58efaee tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:26.919788 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bc92fbf6-11b4-402b-bf15-d621a58efaee tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:26.921006 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-bc92fbf6-11b4-402b-bf15-d621a58efaee tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.175221 Aug 26 08:54:26.921580 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 166/330] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:26 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:27.685602 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4c6a71d7-72fd-409f-9cf5-d467ab7f6ef2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:27.686216 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4c6a71d7-72fd-409f-9cf5-d467ab7f6ef2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:27.693648 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c6a71d7-72fd-409f-9cf5-d467ab7f6ef2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:27.694140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c6a71d7-72fd-409f-9cf5-d467ab7f6ef2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:27.694567 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c6a71d7-72fd-409f-9cf5-d467ab7f6ef2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:27.695325 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c6a71d7-72fd-409f-9cf5-d467ab7f6ef2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:27.695811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c6a71d7-72fd-409f-9cf5-d467ab7f6ef2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:27.696270 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c6a71d7-72fd-409f-9cf5-d467ab7f6ef2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:27.834918 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4c6a71d7-72fd-409f-9cf5-d467ab7f6ef2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:27.840545 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-462851a9-846c-4257-affb-e384232acfd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:27.841120 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-462851a9-846c-4257-affb-e384232acfd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:27.842826 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4c6a71d7-72fd-409f-9cf5-d467ab7f6ef2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.161252 Aug 26 08:54:27.843417 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 165/331] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:27 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:54:27.848304 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-462851a9-846c-4257-affb-e384232acfd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:27.848802 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-462851a9-846c-4257-affb-e384232acfd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:27.849401 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-462851a9-846c-4257-affb-e384232acfd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:27.850322 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-462851a9-846c-4257-affb-e384232acfd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:27.850964 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-462851a9-846c-4257-affb-e384232acfd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:27.851449 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-462851a9-846c-4257-affb-e384232acfd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:27.945188 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-933b396b-5b9c-4543-9055-8722f856ff7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:27.945880 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-933b396b-5b9c-4543-9055-8722f856ff7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:27.954179 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-933b396b-5b9c-4543-9055-8722f856ff7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:27.954698 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-933b396b-5b9c-4543-9055-8722f856ff7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:27.955304 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-933b396b-5b9c-4543-9055-8722f856ff7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:27.956248 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-933b396b-5b9c-4543-9055-8722f856ff7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:27.956738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-933b396b-5b9c-4543-9055-8722f856ff7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:27.957257 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-933b396b-5b9c-4543-9055-8722f856ff7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:28.000853 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-462851a9-846c-4257-affb-e384232acfd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:28.013196 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-462851a9-846c-4257-affb-e384232acfd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.176408 Aug 26 08:54:28.013920 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 167/332] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:27 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:28.119294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-933b396b-5b9c-4543-9055-8722f856ff7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:28.130030 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-933b396b-5b9c-4543-9055-8722f856ff7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:28.131483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-933b396b-5b9c-4543-9055-8722f856ff7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:28.132655 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-933b396b-5b9c-4543-9055-8722f856ff7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.191600 Aug 26 08:54:28.133540 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 166/333] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:27 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:28.864690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e0c81cf3-514f-4658-b7a7-55c46b175403 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:28.865259 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e0c81cf3-514f-4658-b7a7-55c46b175403 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:28.872294 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e0c81cf3-514f-4658-b7a7-55c46b175403 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:28.872793 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e0c81cf3-514f-4658-b7a7-55c46b175403 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:28.873225 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e0c81cf3-514f-4658-b7a7-55c46b175403 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:28.873912 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e0c81cf3-514f-4658-b7a7-55c46b175403 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:28.874366 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e0c81cf3-514f-4658-b7a7-55c46b175403 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:28.874785 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e0c81cf3-514f-4658-b7a7-55c46b175403 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:29.024456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e0c81cf3-514f-4658-b7a7-55c46b175403 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:29.033720 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e0c81cf3-514f-4658-b7a7-55c46b175403 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.173051 Aug 26 08:54:29.033959 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9481b1c0-6c96-485d-9506-de8e1a086495 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:29.034500 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 168/334] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:28 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:29.034592 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9481b1c0-6c96-485d-9506-de8e1a086495 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:29.041821 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9481b1c0-6c96-485d-9506-de8e1a086495 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:29.042312 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9481b1c0-6c96-485d-9506-de8e1a086495 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:29.042732 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9481b1c0-6c96-485d-9506-de8e1a086495 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:29.043454 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9481b1c0-6c96-485d-9506-de8e1a086495 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:29.043946 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9481b1c0-6c96-485d-9506-de8e1a086495 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:29.044608 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9481b1c0-6c96-485d-9506-de8e1a086495 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:29.155971 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f904982d-41ee-479e-88fb-b46a1bbdfe42 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:29.156574 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f904982d-41ee-479e-88fb-b46a1bbdfe42 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:29.163749 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f904982d-41ee-479e-88fb-b46a1bbdfe42 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:29.164226 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f904982d-41ee-479e-88fb-b46a1bbdfe42 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:29.164666 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f904982d-41ee-479e-88fb-b46a1bbdfe42 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:29.165409 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f904982d-41ee-479e-88fb-b46a1bbdfe42 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:29.165873 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f904982d-41ee-479e-88fb-b46a1bbdfe42 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:29.166325 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f904982d-41ee-479e-88fb-b46a1bbdfe42 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:29.198222 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9481b1c0-6c96-485d-9506-de8e1a086495 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:29.210201 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9481b1c0-6c96-485d-9506-de8e1a086495 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.180149 Aug 26 08:54:29.210796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 167/335] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:29 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:29.311206 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f904982d-41ee-479e-88fb-b46a1bbdfe42 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:29.319792 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f904982d-41ee-479e-88fb-b46a1bbdfe42 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:29.321295 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f904982d-41ee-479e-88fb-b46a1bbdfe42 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:29.322477 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f904982d-41ee-479e-88fb-b46a1bbdfe42 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1742 microversion: 2.20 time: 0.170479 Aug 26 08:54:29.323254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 169/336] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:29 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1742 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:30.056407 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7bc3084f-4b20-4797-bc26-68a58045bcc9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:30.057650 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-7bc3084f-4b20-4797-bc26-68a58045bcc9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:30.070507 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7bc3084f-4b20-4797-bc26-68a58045bcc9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:30.071545 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7bc3084f-4b20-4797-bc26-68a58045bcc9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:30.072301 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7bc3084f-4b20-4797-bc26-68a58045bcc9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:30.073481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7bc3084f-4b20-4797-bc26-68a58045bcc9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:30.074259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7bc3084f-4b20-4797-bc26-68a58045bcc9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:30.075018 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7bc3084f-4b20-4797-bc26-68a58045bcc9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:30.237083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-09db31b1-3c96-422f-8a40-c8a8e354c9f2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:30.247538 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-09db31b1-3c96-422f-8a40-c8a8e354c9f2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:30.268399 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09db31b1-3c96-422f-8a40-c8a8e354c9f2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:30.269177 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09db31b1-3c96-422f-8a40-c8a8e354c9f2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:30.269870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09db31b1-3c96-422f-8a40-c8a8e354c9f2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:30.270851 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09db31b1-3c96-422f-8a40-c8a8e354c9f2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:30.271564 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09db31b1-3c96-422f-8a40-c8a8e354c9f2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:30.272205 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09db31b1-3c96-422f-8a40-c8a8e354c9f2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:30.321928 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-7bc3084f-4b20-4797-bc26-68a58045bcc9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:30.331173 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7bc3084f-4b20-4797-bc26-68a58045bcc9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.279487 Aug 26 08:54:30.342992 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 168/337] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:30 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:30.350142 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6dd897dd-9e18-4bba-b4a9-b6bfdcb4c8aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:30.359760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6dd897dd-9e18-4bba-b4a9-b6bfdcb4c8aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:30.375868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6dd897dd-9e18-4bba-b4a9-b6bfdcb4c8aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:30.378842 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6dd897dd-9e18-4bba-b4a9-b6bfdcb4c8aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:30.379511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6dd897dd-9e18-4bba-b4a9-b6bfdcb4c8aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:30.380396 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6dd897dd-9e18-4bba-b4a9-b6bfdcb4c8aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:30.380720 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6dd897dd-9e18-4bba-b4a9-b6bfdcb4c8aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:30.381850 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6dd897dd-9e18-4bba-b4a9-b6bfdcb4c8aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:30.496572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-09db31b1-3c96-422f-8a40-c8a8e354c9f2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:30.523089 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-09db31b1-3c96-422f-8a40-c8a8e354c9f2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1703 microversion: 2.1 time: 0.290864 Aug 26 08:54:30.526255 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 170/338] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:30 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1703 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:30.550131 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-abe748ec-bbdb-41be-a8f4-59a327ff6a84 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:54:30.559497 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-abe748ec-bbdb-41be-a8f4-59a327ff6a84 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:30.560803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-abe748ec-bbdb-41be-a8f4-59a327ff6a84 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:30.561407 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-abe748ec-bbdb-41be-a8f4-59a327ff6a84 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:30.568004 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6dd897dd-9e18-4bba-b4a9-b6bfdcb4c8aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:30.577585 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6dd897dd-9e18-4bba-b4a9-b6bfdcb4c8aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:30.579921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6dd897dd-9e18-4bba-b4a9-b6bfdcb4c8aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:30.581241 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6dd897dd-9e18-4bba-b4a9-b6bfdcb4c8aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1742 microversion: 2.20 time: 0.235144 Aug 26 08:54:30.586032 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 169/339] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:30 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1742 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:54:30.589451 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-abe748ec-bbdb-41be-a8f4-59a327ff6a84 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Going to try to start instance {{(pid=132217) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 08:54:30.638983 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-abe748ec-bbdb-41be-a8f4-59a327ff6a84 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "POST /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/action" status: 202 len: 0 microversion: 2.1 time: 0.093344 Aug 26 08:54:30.639703 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 171/340] 10.222.0.71 () {60 vars in 1278 bytes} [Fri Aug 26 08:54:30 2022] POST /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:54:30.649322 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1cfde6ed-40e0-44d9-b0d6-175c71ffa66c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:30.650039 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1cfde6ed-40e0-44d9-b0d6-175c71ffa66c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:30.658853 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1cfde6ed-40e0-44d9-b0d6-175c71ffa66c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:30.659431 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1cfde6ed-40e0-44d9-b0d6-175c71ffa66c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:30.659816 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1cfde6ed-40e0-44d9-b0d6-175c71ffa66c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:30.664692 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1cfde6ed-40e0-44d9-b0d6-175c71ffa66c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:30.664692 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1cfde6ed-40e0-44d9-b0d6-175c71ffa66c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:30.664692 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1cfde6ed-40e0-44d9-b0d6-175c71ffa66c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:30.859716 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1cfde6ed-40e0-44d9-b0d6-175c71ffa66c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:30.869668 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1cfde6ed-40e0-44d9-b0d6-175c71ffa66c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1712 microversion: 2.1 time: 0.224781 Aug 26 08:54:30.870930 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 170/341] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:30 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1712 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:31.356090 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-23315a07-f296-4d69-9e28-46929be96c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:31.356850 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-23315a07-f296-4d69-9e28-46929be96c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:31.364417 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23315a07-f296-4d69-9e28-46929be96c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:31.364899 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23315a07-f296-4d69-9e28-46929be96c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:31.365358 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23315a07-f296-4d69-9e28-46929be96c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:31.366130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23315a07-f296-4d69-9e28-46929be96c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:31.366508 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23315a07-f296-4d69-9e28-46929be96c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:31.366935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23315a07-f296-4d69-9e28-46929be96c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:31.558713 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-23315a07-f296-4d69-9e28-46929be96c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:31.567308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-23315a07-f296-4d69-9e28-46929be96c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.215530 Aug 26 08:54:31.567892 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 172/342] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:31 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:31.610527 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-63c79bf1-1916-473c-bb29-01467ae2f128 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:31.610986 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-63c79bf1-1916-473c-bb29-01467ae2f128 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:31.619751 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-63c79bf1-1916-473c-bb29-01467ae2f128 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:31.619994 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-63c79bf1-1916-473c-bb29-01467ae2f128 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:31.620535 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-63c79bf1-1916-473c-bb29-01467ae2f128 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:31.621250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-63c79bf1-1916-473c-bb29-01467ae2f128 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:31.621768 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-63c79bf1-1916-473c-bb29-01467ae2f128 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:31.622375 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-63c79bf1-1916-473c-bb29-01467ae2f128 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:31.864483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-63c79bf1-1916-473c-bb29-01467ae2f128 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:31.873990 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-63c79bf1-1916-473c-bb29-01467ae2f128 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:31.875388 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-63c79bf1-1916-473c-bb29-01467ae2f128 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:31.876588 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-63c79bf1-1916-473c-bb29-01467ae2f128 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1742 microversion: 2.20 time: 0.274267 Aug 26 08:54:31.877293 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 171/343] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:31 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1742 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:31.893550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b0424a7f-6ab2-4c50-ac28-40c729364e8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:31.894546 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b0424a7f-6ab2-4c50-ac28-40c729364e8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:31.908149 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b0424a7f-6ab2-4c50-ac28-40c729364e8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:31.908865 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b0424a7f-6ab2-4c50-ac28-40c729364e8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:31.909523 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b0424a7f-6ab2-4c50-ac28-40c729364e8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:31.910723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b0424a7f-6ab2-4c50-ac28-40c729364e8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:31.911518 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b0424a7f-6ab2-4c50-ac28-40c729364e8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:31.912231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b0424a7f-6ab2-4c50-ac28-40c729364e8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:32.102691 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b0424a7f-6ab2-4c50-ac28-40c729364e8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:32.116465 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b0424a7f-6ab2-4c50-ac28-40c729364e8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1712 microversion: 2.1 time: 0.226752 Aug 26 08:54:32.117203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 173/344] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:31 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1712 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:32.609115 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-0a340659-756c-48db-88cb-af78c28a57be req-e602d109-7df7-47f7-8ad1-7b1e678ea048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0d2d4-3218-426b-a548-91c5891780fa", "name": "network-vif-plugged", "status": "completed", "tag": "61d58bf1-2d6c-4df7-8638-a30df721d2e9"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:54:32.610337 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-bc5af731-ce0a-42d7-b45b-e0f25ddefebc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:32.616321 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-bc5af731-ce0a-42d7-b45b-e0f25ddefebc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:32.644469 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc5af731-ce0a-42d7-b45b-e0f25ddefebc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:32.648213 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc5af731-ce0a-42d7-b45b-e0f25ddefebc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:32.664836 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc5af731-ce0a-42d7-b45b-e0f25ddefebc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:32.668396 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-0a340659-756c-48db-88cb-af78c28a57be req-e602d109-7df7-47f7-8ad1-7b1e678ea048 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:32.669120 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-0a340659-756c-48db-88cb-af78c28a57be req-e602d109-7df7-47f7-8ad1-7b1e678ea048 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:32.669552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-0a340659-756c-48db-88cb-af78c28a57be req-e602d109-7df7-47f7-8ad1-7b1e678ea048 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:32.675124 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc5af731-ce0a-42d7-b45b-e0f25ddefebc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:32.676323 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc5af731-ce0a-42d7-b45b-e0f25ddefebc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:32.677131 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc5af731-ce0a-42d7-b45b-e0f25ddefebc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:32.810339 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-0a340659-756c-48db-88cb-af78c28a57be req-e602d109-7df7-47f7-8ad1-7b1e678ea048 service nova] Creating event network-vif-plugged:61d58bf1-2d6c-4df7-8638-a30df721d2e9 for instance 8de0d2d4-3218-426b-a548-91c5891780fa on hv-cinder-85236 Aug 26 08:54:32.835328 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-0a340659-756c-48db-88cb-af78c28a57be req-e602d109-7df7-47f7-8ad1-7b1e678ea048 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257915 Aug 26 08:54:32.838672 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 172/345] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:54:32.908617 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2e41ccbd-46b6-4d1e-91e8-c203b12ecf0a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:32.909657 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2e41ccbd-46b6-4d1e-91e8-c203b12ecf0a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:32.951114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2e41ccbd-46b6-4d1e-91e8-c203b12ecf0a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:32.952438 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2e41ccbd-46b6-4d1e-91e8-c203b12ecf0a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:32.953160 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2e41ccbd-46b6-4d1e-91e8-c203b12ecf0a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:32.954257 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2e41ccbd-46b6-4d1e-91e8-c203b12ecf0a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:32.955181 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2e41ccbd-46b6-4d1e-91e8-c203b12ecf0a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:32.956035 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2e41ccbd-46b6-4d1e-91e8-c203b12ecf0a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:33.169825 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2e41ccbd-46b6-4d1e-91e8-c203b12ecf0a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:33.198928 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2e41ccbd-46b6-4d1e-91e8-c203b12ecf0a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:33.206693 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2e41ccbd-46b6-4d1e-91e8-c203b12ecf0a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:33.208518 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2e41ccbd-46b6-4d1e-91e8-c203b12ecf0a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1742 microversion: 2.20 time: 0.307809 Aug 26 08:54:33.227372 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bc5af731-ce0a-42d7-b45b-e0f25ddefebc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:33.229228 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 173/346] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:32 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1742 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:33.236669 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b3f48882-dbc0-47f6-a78c-3b7a3e56f171 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:33.237778 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b3f48882-dbc0-47f6-a78c-3b7a3e56f171 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:33.250231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-bc5af731-ce0a-42d7-b45b-e0f25ddefebc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.653576 Aug 26 08:54:33.255423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 174/347] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:32 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:33.258983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b3f48882-dbc0-47f6-a78c-3b7a3e56f171 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:33.259920 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b3f48882-dbc0-47f6-a78c-3b7a3e56f171 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:33.261243 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b3f48882-dbc0-47f6-a78c-3b7a3e56f171 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:33.262308 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b3f48882-dbc0-47f6-a78c-3b7a3e56f171 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:33.263028 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b3f48882-dbc0-47f6-a78c-3b7a3e56f171 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:33.263679 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b3f48882-dbc0-47f6-a78c-3b7a3e56f171 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:33.482001 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b3f48882-dbc0-47f6-a78c-3b7a3e56f171 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:33.498407 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b3f48882-dbc0-47f6-a78c-3b7a3e56f171 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1712 microversion: 2.1 time: 0.265852 Aug 26 08:54:33.510945 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 174/348] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:33 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1712 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:34.240889 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-904fc64b-fdda-4873-a990-fce20c540ea4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:34.243413 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-904fc64b-fdda-4873-a990-fce20c540ea4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:34.254116 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-904fc64b-fdda-4873-a990-fce20c540ea4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:34.256365 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-904fc64b-fdda-4873-a990-fce20c540ea4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:34.257042 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-904fc64b-fdda-4873-a990-fce20c540ea4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:34.258625 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-904fc64b-fdda-4873-a990-fce20c540ea4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:34.260385 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-904fc64b-fdda-4873-a990-fce20c540ea4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:34.260897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-904fc64b-fdda-4873-a990-fce20c540ea4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:34.274158 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-14a01fe1-d648-4ba6-8fd0-4cad1be60d15 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:34.276397 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-14a01fe1-d648-4ba6-8fd0-4cad1be60d15 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:34.298680 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-14a01fe1-d648-4ba6-8fd0-4cad1be60d15 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:34.302298 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-14a01fe1-d648-4ba6-8fd0-4cad1be60d15 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:34.303079 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-14a01fe1-d648-4ba6-8fd0-4cad1be60d15 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:34.304464 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-14a01fe1-d648-4ba6-8fd0-4cad1be60d15 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:34.307679 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-14a01fe1-d648-4ba6-8fd0-4cad1be60d15 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:34.308124 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-14a01fe1-d648-4ba6-8fd0-4cad1be60d15 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:34.583875 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-14a01fe1-d648-4ba6-8fd0-4cad1be60d15 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:34.593804 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-14a01fe1-d648-4ba6-8fd0-4cad1be60d15 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.326779 Aug 26 08:54:34.594416 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 175/349] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:34 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:54:34.608206 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5aeda0f2-c6da-4ae2-a81a-3eeb2334d765 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:34.608857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5aeda0f2-c6da-4ae2-a81a-3eeb2334d765 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:34.615819 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5aeda0f2-c6da-4ae2-a81a-3eeb2334d765 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:34.616328 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5aeda0f2-c6da-4ae2-a81a-3eeb2334d765 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:34.616779 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5aeda0f2-c6da-4ae2-a81a-3eeb2334d765 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:34.617516 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5aeda0f2-c6da-4ae2-a81a-3eeb2334d765 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:34.618022 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5aeda0f2-c6da-4ae2-a81a-3eeb2334d765 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:34.619489 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5aeda0f2-c6da-4ae2-a81a-3eeb2334d765 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:34.875776 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5aeda0f2-c6da-4ae2-a81a-3eeb2334d765 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:34.887822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5aeda0f2-c6da-4ae2-a81a-3eeb2334d765 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1712 microversion: 2.1 time: 0.291261 Aug 26 08:54:34.888513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 176/350] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:34 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1712 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:34.949367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-904fc64b-fdda-4873-a990-fce20c540ea4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:34.973412 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-904fc64b-fdda-4873-a990-fce20c540ea4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:34.975344 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-904fc64b-fdda-4873-a990-fce20c540ea4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:35.002573 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-904fc64b-fdda-4873-a990-fce20c540ea4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1742 microversion: 2.20 time: 0.745352 Aug 26 08:54:35.016655 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 175/351] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:34 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1742 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:35.617310 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1075ad04-c981-4d16-adeb-6c40efa20be5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:35.618458 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1075ad04-c981-4d16-adeb-6c40efa20be5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:35.625599 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1075ad04-c981-4d16-adeb-6c40efa20be5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:35.626572 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1075ad04-c981-4d16-adeb-6c40efa20be5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:35.626572 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1075ad04-c981-4d16-adeb-6c40efa20be5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:35.627499 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1075ad04-c981-4d16-adeb-6c40efa20be5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:35.627903 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1075ad04-c981-4d16-adeb-6c40efa20be5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:35.628343 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1075ad04-c981-4d16-adeb-6c40efa20be5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:35.880155 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1075ad04-c981-4d16-adeb-6c40efa20be5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:35.889699 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1075ad04-c981-4d16-adeb-6c40efa20be5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1502 microversion: 2.1 time: 0.276433 Aug 26 08:54:35.890507 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 177/352] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:35 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:54:35.911966 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-36260482-38af-444b-91f6-4d550b7d4f6e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ee5d44d-f54b-42c4-8f1a-8a818545b438"}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:54:35.916689 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-36260482-38af-444b-91f6-4d550b7d4f6e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:35.923780 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ef63aa27-cd57-4ea5-9e38-d2d81897c127 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:35.924572 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ef63aa27-cd57-4ea5-9e38-d2d81897c127 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:35.928704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-36260482-38af-444b-91f6-4d550b7d4f6e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:35.929482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-36260482-38af-444b-91f6-4d550b7d4f6e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:35.930146 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-36260482-38af-444b-91f6-4d550b7d4f6e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:35.931110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-36260482-38af-444b-91f6-4d550b7d4f6e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:35.931726 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-36260482-38af-444b-91f6-4d550b7d4f6e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:35.932305 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-36260482-38af-444b-91f6-4d550b7d4f6e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:35.932826 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ef63aa27-cd57-4ea5-9e38-d2d81897c127 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:35.933415 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ef63aa27-cd57-4ea5-9e38-d2d81897c127 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:35.933950 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ef63aa27-cd57-4ea5-9e38-d2d81897c127 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:35.934849 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ef63aa27-cd57-4ea5-9e38-d2d81897c127 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:35.935673 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ef63aa27-cd57-4ea5-9e38-d2d81897c127 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:35.936241 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ef63aa27-cd57-4ea5-9e38-d2d81897c127 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:35.972128 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-36260482-38af-444b-91f6-4d550b7d4f6e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] HTTP exception thrown: Cannot 'attach_volume' instance 1a8b026c-ef95-4a38-8eca-86005625dd30 while it is in vm_state rescued Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-36260482-38af-444b-91f6-4d550b7d4f6e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Request method failure captured: Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: POST /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30/os-volume_attachments HTTP/1.1 Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 74 Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCImvYbics5fHnhYQUsY3Ln3prZ2azA4IHqkelF0XmV2pym4A3ArmldC0YsDyJoDTxdWgxVyBe3sw83XWKq4Qh_K3R2hFZXymYlcdOpI_XFJZIDGJ3P5USGxZ4W6-2jz0estC8rSJF0fF_u2VYoJyDfEZYq6CSipyAHm6hPNY2gWr8Ss Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 01d9fa7bc7124476aa295e69b120becd Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 08:54:35.973597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 08:54:35.974935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_01d9fa7bc7124476aa295e69b120becd", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:54:35.974935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:54:35.974935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 01d9fa7bc7124476aa295e69b120becd Aug 26 08:54:35.974935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:54:35.974935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-ServerRescueNegativeTestJSON-1223166117-project Aug 26 08:54:35.974935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 08:54:35.974935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 08:54:35.974935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 3aced0ed17b946f9961d87a1d4446c37 Aug 26 08:54:35.974935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1223166117-project Aug 26 08:54:35.974935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Aug 26 08:54:35.974935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {"volumeAttachment": {"volumeId": "8ee5d44d-f54b-42c4-8f1a-8a818545b438"}} Aug 26 08:54:35.974935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Cannot 'attach_volume' instance 1a8b026c-ef95-4a38-8eca-86005625dd30 while it is in vm_state rescued Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'server_id': '1a8b026c-ef95-4a38-8eca-86005625dd30', 'body': {'volumeAttachment': {'volumeId': '8ee5d44d-f54b-42c4-8f1a-8a818545b438'}}} Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1a8b026c-ef95-4a38-8eca-86005625dd30 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:54:35.975709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1a8b026c-ef95-4a38-8eca-86005625dd30 while it is in vm_state rescued Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:54:35.977717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:54:35.980221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:54:35.980221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:54:35.980221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1a8b026c-ef95-4a38-8eca-86005625dd30 while it is in vm_state rescued Aug 26 08:54:35.980221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:54:35.980221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-36260482-38af-444b-91f6-4d550b7d4f6e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Returning 409 to user: Cannot 'attach_volume' instance 1a8b026c-ef95-4a38-8eca-86005625dd30 while it is in vm_state rescued {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:54:35.980221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-36260482-38af-444b-91f6-4d550b7d4f6e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "POST /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.067731 Aug 26 08:54:35.980221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 176/353] 10.222.0.71 () {60 vars in 1323 bytes} [Fri Aug 26 08:54:35 2022] POST /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 26 08:54:35.985619 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-33447291-15d0-4ed4-886e-1e2f82130483 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:54:35.986441 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-33447291-15d0-4ed4-886e-1e2f82130483 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:35.994167 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-33447291-15d0-4ed4-886e-1e2f82130483 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:35.995068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-33447291-15d0-4ed4-886e-1e2f82130483 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:35.995725 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-33447291-15d0-4ed4-886e-1e2f82130483 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:35.996675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-33447291-15d0-4ed4-886e-1e2f82130483 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:35.997330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-33447291-15d0-4ed4-886e-1e2f82130483 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:35.997951 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-33447291-15d0-4ed4-886e-1e2f82130483 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:36.095629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:36.152563 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-33447291-15d0-4ed4-886e-1e2f82130483 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "POST /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30/action" status: 202 len: 0 microversion: 2.1 time: 0.171371 Aug 26 08:54:36.155924 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 177/354] 10.222.0.71 () {60 vars in 1278 bytes} [Fri Aug 26 08:54:35 2022] POST /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 08:54:36.166909 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-900c0467-85e5-437c-8f2e-60e071e9c2f6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:36.173225 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-900c0467-85e5-437c-8f2e-60e071e9c2f6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:36.191506 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-900c0467-85e5-437c-8f2e-60e071e9c2f6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:36.193744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-900c0467-85e5-437c-8f2e-60e071e9c2f6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:36.194771 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-900c0467-85e5-437c-8f2e-60e071e9c2f6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:36.195642 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-900c0467-85e5-437c-8f2e-60e071e9c2f6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:36.198508 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-900c0467-85e5-437c-8f2e-60e071e9c2f6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:36.199026 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-900c0467-85e5-437c-8f2e-60e071e9c2f6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:36.278047 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ef63aa27-cd57-4ea5-9e38-d2d81897c127 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:36.283361 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=100 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:36.313947 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ef63aa27-cd57-4ea5-9e38-d2d81897c127 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1712 microversion: 2.1 time: 0.397378 Aug 26 08:54:36.317795 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 178/355] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:35 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1712 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:36.337060 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-dd5089af-6758-4964-b8ab-64c2158f3cec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:36.341008 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-dd5089af-6758-4964-b8ab-64c2158f3cec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:36.373744 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dd5089af-6758-4964-b8ab-64c2158f3cec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:36.383956 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dd5089af-6758-4964-b8ab-64c2158f3cec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:36.384675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dd5089af-6758-4964-b8ab-64c2158f3cec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:36.385855 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dd5089af-6758-4964-b8ab-64c2158f3cec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:36.386548 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dd5089af-6758-4964-b8ab-64c2158f3cec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:36.387338 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dd5089af-6758-4964-b8ab-64c2158f3cec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:36.661020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-900c0467-85e5-437c-8f2e-60e071e9c2f6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:36.692372 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-900c0467-85e5-437c-8f2e-60e071e9c2f6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:36.700889 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-900c0467-85e5-437c-8f2e-60e071e9c2f6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:36.704081 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-900c0467-85e5-437c-8f2e-60e071e9c2f6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1737 microversion: 2.20 time: 0.543668 Aug 26 08:54:36.706073 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 178/356] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:36 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1737 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:36.725271 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-dd5089af-6758-4964-b8ab-64c2158f3cec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:36.744767 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-dd5089af-6758-4964-b8ab-64c2158f3cec tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1510 microversion: 2.1 time: 0.424394 Aug 26 08:54:36.752195 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 179/357] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:36 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1510 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:37.355391 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-23d96366-a437-4a5d-9111-75130ea50d3f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:37.356323 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-23d96366-a437-4a5d-9111-75130ea50d3f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:37.373320 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23d96366-a437-4a5d-9111-75130ea50d3f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:37.375064 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23d96366-a437-4a5d-9111-75130ea50d3f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:37.376694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23d96366-a437-4a5d-9111-75130ea50d3f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:37.381355 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23d96366-a437-4a5d-9111-75130ea50d3f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:37.382210 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23d96366-a437-4a5d-9111-75130ea50d3f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:37.384740 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23d96366-a437-4a5d-9111-75130ea50d3f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:37.731598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-54890e5a-34ad-4d00-9c1f-e2ffe06d46a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:37.732177 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-54890e5a-34ad-4d00-9c1f-e2ffe06d46a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:37.747354 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-54890e5a-34ad-4d00-9c1f-e2ffe06d46a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:37.749495 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-54890e5a-34ad-4d00-9c1f-e2ffe06d46a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:37.750217 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-54890e5a-34ad-4d00-9c1f-e2ffe06d46a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:37.752896 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-54890e5a-34ad-4d00-9c1f-e2ffe06d46a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:37.753799 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-54890e5a-34ad-4d00-9c1f-e2ffe06d46a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:37.755534 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-54890e5a-34ad-4d00-9c1f-e2ffe06d46a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:37.758608 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-23d96366-a437-4a5d-9111-75130ea50d3f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:37.772529 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-23d96366-a437-4a5d-9111-75130ea50d3f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1712 microversion: 2.1 time: 0.423311 Aug 26 08:54:37.795402 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 179/358] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:37 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1712 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:37.810711 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b5070782-67b9-45aa-9937-b6ce5aff8f1a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:37.811365 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b5070782-67b9-45aa-9937-b6ce5aff8f1a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:37.825718 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b5070782-67b9-45aa-9937-b6ce5aff8f1a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:37.826233 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b5070782-67b9-45aa-9937-b6ce5aff8f1a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:37.826653 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b5070782-67b9-45aa-9937-b6ce5aff8f1a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:37.827451 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b5070782-67b9-45aa-9937-b6ce5aff8f1a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:37.827862 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b5070782-67b9-45aa-9937-b6ce5aff8f1a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:37.828292 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b5070782-67b9-45aa-9937-b6ce5aff8f1a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:38.224266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-54890e5a-34ad-4d00-9c1f-e2ffe06d46a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:38.253389 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-54890e5a-34ad-4d00-9c1f-e2ffe06d46a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:38.259927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-54890e5a-34ad-4d00-9c1f-e2ffe06d46a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:38.265477 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-54890e5a-34ad-4d00-9c1f-e2ffe06d46a9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1737 microversion: 2.20 time: 0.538370 Aug 26 08:54:38.287212 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 180/359] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:37 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1737 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:38.802706 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f7618ac8-75e6-4db2-9ff1-dd513b3f27db tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:38.812344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f7618ac8-75e6-4db2-9ff1-dd513b3f27db tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:38.856521 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f7618ac8-75e6-4db2-9ff1-dd513b3f27db tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:38.857712 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f7618ac8-75e6-4db2-9ff1-dd513b3f27db tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:38.858405 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f7618ac8-75e6-4db2-9ff1-dd513b3f27db tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:38.859503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f7618ac8-75e6-4db2-9ff1-dd513b3f27db tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:38.860222 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f7618ac8-75e6-4db2-9ff1-dd513b3f27db tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:38.860865 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f7618ac8-75e6-4db2-9ff1-dd513b3f27db tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:38.863794 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b5070782-67b9-45aa-9937-b6ce5aff8f1a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:38.918790 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b5070782-67b9-45aa-9937-b6ce5aff8f1a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1510 microversion: 2.1 time: 1.114000 Aug 26 08:54:38.930949 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 180/360] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:37 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1510 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:39.167503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f7618ac8-75e6-4db2-9ff1-dd513b3f27db tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:39.176974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f7618ac8-75e6-4db2-9ff1-dd513b3f27db tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1712 microversion: 2.1 time: 0.382196 Aug 26 08:54:39.193976 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 181/361] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:38 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1712 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:54:39.310776 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-793785eb-c5b4-407f-bd63-b77f31380bc3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:39.311410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-793785eb-c5b4-407f-bd63-b77f31380bc3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:39.317939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-793785eb-c5b4-407f-bd63-b77f31380bc3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:39.318490 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-793785eb-c5b4-407f-bd63-b77f31380bc3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:39.320341 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-793785eb-c5b4-407f-bd63-b77f31380bc3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:39.321611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-793785eb-c5b4-407f-bd63-b77f31380bc3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:39.322547 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-793785eb-c5b4-407f-bd63-b77f31380bc3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:39.323442 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-793785eb-c5b4-407f-bd63-b77f31380bc3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:39.715941 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-793785eb-c5b4-407f-bd63-b77f31380bc3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:39.752129 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-793785eb-c5b4-407f-bd63-b77f31380bc3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:39.759096 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-793785eb-c5b4-407f-bd63-b77f31380bc3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:39.761877 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-793785eb-c5b4-407f-bd63-b77f31380bc3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1737 microversion: 2.20 time: 0.455056 Aug 26 08:54:39.780260 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 181/362] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:39 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1737 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:39.949993 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1895071b-26a0-4e3a-833e-82483d9fea53 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:39.952100 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1895071b-26a0-4e3a-833e-82483d9fea53 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:39.975838 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1895071b-26a0-4e3a-833e-82483d9fea53 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:39.976839 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1895071b-26a0-4e3a-833e-82483d9fea53 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:39.979349 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1895071b-26a0-4e3a-833e-82483d9fea53 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:39.980382 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1895071b-26a0-4e3a-833e-82483d9fea53 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:39.983376 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1895071b-26a0-4e3a-833e-82483d9fea53 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:39.984261 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1895071b-26a0-4e3a-833e-82483d9fea53 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:40.220596 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-64bf3713-e44f-4a24-ab6d-d5791ee5b17e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:40.222795 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-64bf3713-e44f-4a24-ab6d-d5791ee5b17e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:40.235307 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1895071b-26a0-4e3a-833e-82483d9fea53 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:40.301438 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1895071b-26a0-4e3a-833e-82483d9fea53 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1510 microversion: 2.1 time: 0.359423 Aug 26 08:54:40.318195 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 182/363] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:39 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:40.340022 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-64bf3713-e44f-4a24-ab6d-d5791ee5b17e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:40.340939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-64bf3713-e44f-4a24-ab6d-d5791ee5b17e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:40.341731 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-64bf3713-e44f-4a24-ab6d-d5791ee5b17e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:40.342967 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-64bf3713-e44f-4a24-ab6d-d5791ee5b17e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:40.343739 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-64bf3713-e44f-4a24-ab6d-d5791ee5b17e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:40.344415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-64bf3713-e44f-4a24-ab6d-d5791ee5b17e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:40.663130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-64bf3713-e44f-4a24-ab6d-d5791ee5b17e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:40.749837 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-64bf3713-e44f-4a24-ab6d-d5791ee5b17e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1716 microversion: 2.1 time: 0.551366 Aug 26 08:54:40.795931 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 182/364] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:40 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1716 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:40.799280 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1d845c54-29f5-440a-888b-c4ae04688519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:40.800403 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1d845c54-29f5-440a-888b-c4ae04688519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:40.807925 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1d845c54-29f5-440a-888b-c4ae04688519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:40.808810 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1d845c54-29f5-440a-888b-c4ae04688519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:40.809477 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1d845c54-29f5-440a-888b-c4ae04688519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:40.812097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1d845c54-29f5-440a-888b-c4ae04688519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:40.812903 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1d845c54-29f5-440a-888b-c4ae04688519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:40.813685 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1d845c54-29f5-440a-888b-c4ae04688519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:40.991561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1869383243", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1673214775", "security_groups": [{"name": "tempest-secgroup-smoke-1931617738"}], "networks": [{"uuid": "29c0f487-40e8-46e5-bf03-83c129904d85"}], "block_device_mapping_v2": [{"uuid": "b910f191-687a-4d16-a9a2-efcefeb7a209", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:54:41.310825 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1d845c54-29f5-440a-888b-c4ae04688519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:41.317429 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.network.neutron [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] validate_networks() for [('29c0f487-40e8-46e5-bf03-83c129904d85', None, None, None, None, None)] {{(pid=132217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:54:41.325033 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1d845c54-29f5-440a-888b-c4ae04688519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:41.332712 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1d845c54-29f5-440a-888b-c4ae04688519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:41.342405 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1d845c54-29f5-440a-888b-c4ae04688519 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1737 microversion: 2.20 time: 0.545162 Aug 26 08:54:41.350437 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 183/365] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:40 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1737 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:54:41.370485 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-cb4229f0-8066-46c7-b65d-e7b93ddad888 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:41.372874 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-cb4229f0-8066-46c7-b65d-e7b93ddad888 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:41.396601 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cb4229f0-8066-46c7-b65d-e7b93ddad888 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:41.397097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cb4229f0-8066-46c7-b65d-e7b93ddad888 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:41.397532 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cb4229f0-8066-46c7-b65d-e7b93ddad888 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:41.411956 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cb4229f0-8066-46c7-b65d-e7b93ddad888 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:41.412459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cb4229f0-8066-46c7-b65d-e7b93ddad888 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:41.412892 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cb4229f0-8066-46c7-b65d-e7b93ddad888 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:41.695254 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-cb4229f0-8066-46c7-b65d-e7b93ddad888 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:41.708433 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-cb4229f0-8066-46c7-b65d-e7b93ddad888 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1510 microversion: 2.1 time: 0.354190 Aug 26 08:54:41.709093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 184/366] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:41 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1510 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:42.107096 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Flavor limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:54:42.107584 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Image limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:54:42.108227 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Flavor pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:54:42.108643 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Image pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:54:42.109254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:54:42.135303 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:42.135832 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:42.136273 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:42.137048 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:42.137498 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:42.147411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:42.211930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Getting quotas for project 37cc63bca9274f9ba58f8a92a499a36d. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:54:42.221643 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Getting quotas for user 229fe8f73e074ef89b1110da844268df and project 37cc63bca9274f9ba58f8a92a499a36d. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:54:42.338994 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Going to run 1 instances... {{(pid=132217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:54:42.344351 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b910f191-687a-4d16-a9a2-efcefeb7a209',volume_size=None,volume_type=None)] {{(pid=132217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:54:42.382097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c582c7bc-f85c-49ce-b3c3-5ab79eb5701b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:42.384109 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c582c7bc-f85c-49ce-b3c3-5ab79eb5701b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:42.406179 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c582c7bc-f85c-49ce-b3c3-5ab79eb5701b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:42.406690 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c582c7bc-f85c-49ce-b3c3-5ab79eb5701b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:42.409517 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c582c7bc-f85c-49ce-b3c3-5ab79eb5701b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:42.414066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c582c7bc-f85c-49ce-b3c3-5ab79eb5701b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:42.415113 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c582c7bc-f85c-49ce-b3c3-5ab79eb5701b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:42.415899 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c582c7bc-f85c-49ce-b3c3-5ab79eb5701b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:42.829475 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-dcfa567f-7fdf-441c-8d51-836e309083be tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.842112 Aug 26 08:54:42.842099 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 183/367] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:54:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 08:54:42.857143 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c582c7bc-f85c-49ce-b3c3-5ab79eb5701b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:42.869037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a086610a-db93-4ea6-9d56-92790dd87fdf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:42.869670 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a086610a-db93-4ea6-9d56-92790dd87fdf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:42.883062 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c582c7bc-f85c-49ce-b3c3-5ab79eb5701b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:42.884791 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c582c7bc-f85c-49ce-b3c3-5ab79eb5701b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:42.886120 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c582c7bc-f85c-49ce-b3c3-5ab79eb5701b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1737 microversion: 2.20 time: 0.508078 Aug 26 08:54:42.894508 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 185/368] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:42 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1737 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:42.899948 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-49113383-8b77-4355-bf2e-f1910c0477af tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:42.900616 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-49113383-8b77-4355-bf2e-f1910c0477af tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:42.909917 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a086610a-db93-4ea6-9d56-92790dd87fdf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:42.910571 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a086610a-db93-4ea6-9d56-92790dd87fdf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:42.923862 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a086610a-db93-4ea6-9d56-92790dd87fdf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:42.925346 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a086610a-db93-4ea6-9d56-92790dd87fdf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:42.926267 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a086610a-db93-4ea6-9d56-92790dd87fdf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:42.927074 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a086610a-db93-4ea6-9d56-92790dd87fdf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:43.136669 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-49113383-8b77-4355-bf2e-f1910c0477af tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:43.147817 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-49113383-8b77-4355-bf2e-f1910c0477af tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1089 microversion: 2.1 time: 0.251867 Aug 26 08:54:43.164195 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 186/369] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:42 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1089 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:43.305647 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a086610a-db93-4ea6-9d56-92790dd87fdf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:43.314587 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a086610a-db93-4ea6-9d56-92790dd87fdf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1510 microversion: 2.1 time: 0.470843 Aug 26 08:54:43.315236 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 184/370] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:42 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1510 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:43.921063 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-70dfd6a5-1849-47e9-81e5-1d79f0e6be4d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:43.922944 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-70dfd6a5-1849-47e9-81e5-1d79f0e6be4d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:43.949204 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-70dfd6a5-1849-47e9-81e5-1d79f0e6be4d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:43.951335 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-70dfd6a5-1849-47e9-81e5-1d79f0e6be4d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:43.952513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-70dfd6a5-1849-47e9-81e5-1d79f0e6be4d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:43.953990 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-70dfd6a5-1849-47e9-81e5-1d79f0e6be4d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:43.957607 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-70dfd6a5-1849-47e9-81e5-1d79f0e6be4d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:43.959616 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-70dfd6a5-1849-47e9-81e5-1d79f0e6be4d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:44.169385 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-bff5a743-238c-4c06-936f-a5a7d506f59e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:44.170168 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-bff5a743-238c-4c06-936f-a5a7d506f59e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:44.187557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bff5a743-238c-4c06-936f-a5a7d506f59e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:44.188259 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bff5a743-238c-4c06-936f-a5a7d506f59e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:44.188798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bff5a743-238c-4c06-936f-a5a7d506f59e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:44.189728 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bff5a743-238c-4c06-936f-a5a7d506f59e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:44.190406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bff5a743-238c-4c06-936f-a5a7d506f59e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:44.191072 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bff5a743-238c-4c06-936f-a5a7d506f59e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:44.199784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-70dfd6a5-1849-47e9-81e5-1d79f0e6be4d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:44.211963 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-70dfd6a5-1849-47e9-81e5-1d79f0e6be4d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:44.213477 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-70dfd6a5-1849-47e9-81e5-1d79f0e6be4d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:44.214735 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-70dfd6a5-1849-47e9-81e5-1d79f0e6be4d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1737 microversion: 2.20 time: 0.301751 Aug 26 08:54:44.221698 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 187/371] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:43 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1737 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:44.275100 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bff5a743-238c-4c06-936f-a5a7d506f59e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:44.286483 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-bff5a743-238c-4c06-936f-a5a7d506f59e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1139 microversion: 2.1 time: 0.121100 Aug 26 08:54:44.303094 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 185/372] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:44 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1139 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:54:44.338768 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5df221e9-5247-4812-9c85-5acbc1077ce2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:44.339442 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5df221e9-5247-4812-9c85-5acbc1077ce2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:44.351406 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5df221e9-5247-4812-9c85-5acbc1077ce2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:44.351910 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5df221e9-5247-4812-9c85-5acbc1077ce2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:44.352433 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5df221e9-5247-4812-9c85-5acbc1077ce2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:44.353147 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5df221e9-5247-4812-9c85-5acbc1077ce2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:44.355993 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5df221e9-5247-4812-9c85-5acbc1077ce2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:44.356676 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5df221e9-5247-4812-9c85-5acbc1077ce2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:44.632173 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5df221e9-5247-4812-9c85-5acbc1077ce2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:44.663449 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5df221e9-5247-4812-9c85-5acbc1077ce2 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1516 microversion: 2.1 time: 0.329490 Aug 26 08:54:44.679990 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 188/373] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:44 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1516 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:54:45.242620 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3ff45f45-3a2d-441f-8bf4-96cb44d4a97c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:45.244851 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3ff45f45-3a2d-441f-8bf4-96cb44d4a97c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:45.269641 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ff45f45-3a2d-441f-8bf4-96cb44d4a97c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:45.270449 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ff45f45-3a2d-441f-8bf4-96cb44d4a97c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:45.271150 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ff45f45-3a2d-441f-8bf4-96cb44d4a97c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:45.272061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ff45f45-3a2d-441f-8bf4-96cb44d4a97c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:45.272690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ff45f45-3a2d-441f-8bf4-96cb44d4a97c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:45.273287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ff45f45-3a2d-441f-8bf4-96cb44d4a97c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:45.311354 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-60bf7333-2786-4d1c-9946-b757fd43bf3f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:45.312742 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-60bf7333-2786-4d1c-9946-b757fd43bf3f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:45.324392 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60bf7333-2786-4d1c-9946-b757fd43bf3f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:45.332461 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60bf7333-2786-4d1c-9946-b757fd43bf3f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:45.333087 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60bf7333-2786-4d1c-9946-b757fd43bf3f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:45.334200 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60bf7333-2786-4d1c-9946-b757fd43bf3f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:45.334933 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60bf7333-2786-4d1c-9946-b757fd43bf3f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:45.335108 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60bf7333-2786-4d1c-9946-b757fd43bf3f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:45.500456 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-60bf7333-2786-4d1c-9946-b757fd43bf3f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:45.510356 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-60bf7333-2786-4d1c-9946-b757fd43bf3f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1187 microversion: 2.1 time: 0.203688 Aug 26 08:54:45.512057 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 189/374] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:45 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1187 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:45.695899 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3ff45f45-3a2d-441f-8bf4-96cb44d4a97c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:45.726545 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3ff45f45-3a2d-441f-8bf4-96cb44d4a97c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:45.730557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3ff45f45-3a2d-441f-8bf4-96cb44d4a97c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:45.733280 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-3ff45f45-3a2d-441f-8bf4-96cb44d4a97c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1737 microversion: 2.20 time: 0.496861 Aug 26 08:54:45.788415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 186/375] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:45 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1737 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:46.549724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d4ead190-c353-4b66-bd92-ee8bba337f55 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:46.550869 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d4ead190-c353-4b66-bd92-ee8bba337f55 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:46.570343 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d4ead190-c353-4b66-bd92-ee8bba337f55 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:46.585581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d4ead190-c353-4b66-bd92-ee8bba337f55 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:46.596649 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d5365179-8c0c-41cf-b890-4ab2728416b3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Action: 'create', calling method: .version_select at 0x7f136c0eaca0>, body: {"keypair": {"name": "tempest-keypair-636125105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcllL8/8bGWk7CRx+ziJn++QMu3DDl6Zcf+NHL72JhPaN17ZigdojCJ0Wca7hyL9bYao4+907WQ0Mh39ObTdKJeAh31tiQkgCtkqRmHiII3l+MgtrviCVz5N3t9fisI2w=="}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:54:46.603748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d4ead190-c353-4b66-bd92-ee8bba337f55 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:46.609106 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d4ead190-c353-4b66-bd92-ee8bba337f55 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:46.610949 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d4ead190-c353-4b66-bd92-ee8bba337f55 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:46.612544 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d4ead190-c353-4b66-bd92-ee8bba337f55 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:46.658614 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-d5365179-8c0c-41cf-b890-4ab2728416b3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Getting quotas for project 01d9fa7bc7124476aa295e69b120becd. Resources: {'key_pairs'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:54:46.684251 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-d5365179-8c0c-41cf-b890-4ab2728416b3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Getting quotas for user 3aced0ed17b946f9961d87a1d4446c37 and project 01d9fa7bc7124476aa295e69b120becd. Resources: {'key_pairs'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:54:46.763662 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d5365179-8c0c-41cf-b890-4ab2728416b3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171142 Aug 26 08:54:46.770831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 187/376] 10.222.0.71 () {60 vars in 1159 bytes} [Fri Aug 26 08:54:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:54:46.786822 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c3903656-07f2-426e-b491-0b828b58deed tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:46.787501 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c3903656-07f2-426e-b491-0b828b58deed tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:46.800893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c3903656-07f2-426e-b491-0b828b58deed tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:46.801659 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c3903656-07f2-426e-b491-0b828b58deed tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:46.802355 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c3903656-07f2-426e-b491-0b828b58deed tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:46.804220 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c3903656-07f2-426e-b491-0b828b58deed tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:46.804900 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c3903656-07f2-426e-b491-0b828b58deed tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:46.805656 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c3903656-07f2-426e-b491-0b828b58deed tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:46.839420 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d4ead190-c353-4b66-bd92-ee8bba337f55 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:46.858550 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d4ead190-c353-4b66-bd92-ee8bba337f55 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1187 microversion: 2.1 time: 0.314402 Aug 26 08:54:46.863440 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 190/377] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:46 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1187 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:54:47.739398 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c3903656-07f2-426e-b491-0b828b58deed tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:47.791711 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c3903656-07f2-426e-b491-0b828b58deed tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:47.805336 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c3903656-07f2-426e-b491-0b828b58deed tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:47.817835 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c3903656-07f2-426e-b491-0b828b58deed tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1737 microversion: 2.20 time: 1.024569 Aug 26 08:54:47.826568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 188/378] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:46 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1737 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:54:47.892924 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1745cc2f-c0bd-4788-8a05-eb38a3aa660f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:47.900739 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1745cc2f-c0bd-4788-8a05-eb38a3aa660f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:47.956265 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=80 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:47.964111 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1745cc2f-c0bd-4788-8a05-eb38a3aa660f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:47.967160 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1745cc2f-c0bd-4788-8a05-eb38a3aa660f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:47.968388 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1745cc2f-c0bd-4788-8a05-eb38a3aa660f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:47.970088 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1745cc2f-c0bd-4788-8a05-eb38a3aa660f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:47.971346 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1745cc2f-c0bd-4788-8a05-eb38a3aa660f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:47.972694 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1745cc2f-c0bd-4788-8a05-eb38a3aa660f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:48.393266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1745cc2f-c0bd-4788-8a05-eb38a3aa660f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:48.430536 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1745cc2f-c0bd-4788-8a05-eb38a3aa660f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1205 microversion: 2.1 time: 0.544489 Aug 26 08:54:48.445203 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 191/379] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:47 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1205 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:48.857698 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-37deff6a-b507-47e4-a02a-f5714f1a64bf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:48.859774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-37deff6a-b507-47e4-a02a-f5714f1a64bf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:48.889288 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37deff6a-b507-47e4-a02a-f5714f1a64bf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:48.893373 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37deff6a-b507-47e4-a02a-f5714f1a64bf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:48.899074 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37deff6a-b507-47e4-a02a-f5714f1a64bf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:48.901060 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37deff6a-b507-47e4-a02a-f5714f1a64bf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:48.903664 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37deff6a-b507-47e4-a02a-f5714f1a64bf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:48.905889 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37deff6a-b507-47e4-a02a-f5714f1a64bf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:49.478743 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-832988cd-aa7c-4b11-be56-022fd1026cfa tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:49.480724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-832988cd-aa7c-4b11-be56-022fd1026cfa tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:49.510977 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-832988cd-aa7c-4b11-be56-022fd1026cfa tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:49.513715 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-832988cd-aa7c-4b11-be56-022fd1026cfa tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:49.515818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-832988cd-aa7c-4b11-be56-022fd1026cfa tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:49.520931 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-832988cd-aa7c-4b11-be56-022fd1026cfa tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:49.523783 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-832988cd-aa7c-4b11-be56-022fd1026cfa tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:49.527486 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-832988cd-aa7c-4b11-be56-022fd1026cfa tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:49.915124 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-37deff6a-b507-47e4-a02a-f5714f1a64bf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:49.967483 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-37deff6a-b507-47e4-a02a-f5714f1a64bf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:49.972320 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-37deff6a-b507-47e4-a02a-f5714f1a64bf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:49.975141 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-37deff6a-b507-47e4-a02a-f5714f1a64bf tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1737 microversion: 2.20 time: 1.124380 Aug 26 08:54:50.004216 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 189/380] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:48 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1737 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:50.348683 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-832988cd-aa7c-4b11-be56-022fd1026cfa tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:50.367316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-832988cd-aa7c-4b11-be56-022fd1026cfa tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1193 microversion: 2.1 time: 0.895720 Aug 26 08:54:50.371070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 192/381] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:49 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1193 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:51.039150 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-603dd350-a888-4f31-9ecb-1a9a791c8325 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:51.047043 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-603dd350-a888-4f31-9ecb-1a9a791c8325 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:51.089062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-603dd350-a888-4f31-9ecb-1a9a791c8325 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:51.100172 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-603dd350-a888-4f31-9ecb-1a9a791c8325 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:51.101309 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-603dd350-a888-4f31-9ecb-1a9a791c8325 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:51.104225 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-603dd350-a888-4f31-9ecb-1a9a791c8325 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:51.107721 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-603dd350-a888-4f31-9ecb-1a9a791c8325 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:51.115930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-603dd350-a888-4f31-9ecb-1a9a791c8325 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:51.402295 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-22ea69c2-4d33-4fb7-a231-27267c01547c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:51.402980 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-22ea69c2-4d33-4fb7-a231-27267c01547c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:51.423450 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-22ea69c2-4d33-4fb7-a231-27267c01547c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:51.424100 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-22ea69c2-4d33-4fb7-a231-27267c01547c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:51.437800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-22ea69c2-4d33-4fb7-a231-27267c01547c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:51.439712 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-22ea69c2-4d33-4fb7-a231-27267c01547c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:51.443082 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-22ea69c2-4d33-4fb7-a231-27267c01547c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:51.458741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-22ea69c2-4d33-4fb7-a231-27267c01547c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:51.819686 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-603dd350-a888-4f31-9ecb-1a9a791c8325 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:51.833988 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-603dd350-a888-4f31-9ecb-1a9a791c8325 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:51.838187 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-603dd350-a888-4f31-9ecb-1a9a791c8325 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:51.842910 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-603dd350-a888-4f31-9ecb-1a9a791c8325 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1737 microversion: 2.20 time: 0.811811 Aug 26 08:54:51.847555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 190/382] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:51 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1737 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:54:52.413344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-22ea69c2-4d33-4fb7-a231-27267c01547c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:52.437355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-22ea69c2-4d33-4fb7-a231-27267c01547c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 1.039519 Aug 26 08:54:52.443963 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 193/383] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:51 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:52.808706 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-175628997", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0095b163-b541-4b8f-a3b6-64656b6e47e8"}], "security_groups": [{"name": "tempest-securitygroup--1482625049"}], "key_name": "tempest-keypair-636125105", "user_data": "}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:54:52.841496 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:52.876470 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3cb2d28f-8d98-4b01-baf2-7fdffeeea6b9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:52.877744 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3cb2d28f-8d98-4b01-baf2-7fdffeeea6b9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:52.902268 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cb2d28f-8d98-4b01-baf2-7fdffeeea6b9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:52.907374 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cb2d28f-8d98-4b01-baf2-7fdffeeea6b9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:52.908057 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cb2d28f-8d98-4b01-baf2-7fdffeeea6b9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:52.910527 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cb2d28f-8d98-4b01-baf2-7fdffeeea6b9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:52.912122 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cb2d28f-8d98-4b01-baf2-7fdffeeea6b9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:52.913360 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cb2d28f-8d98-4b01-baf2-7fdffeeea6b9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:53.146082 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:53.295983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3cb2d28f-8d98-4b01-baf2-7fdffeeea6b9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:53.312766 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3cb2d28f-8d98-4b01-baf2-7fdffeeea6b9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:53.330420 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3cb2d28f-8d98-4b01-baf2-7fdffeeea6b9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:53.331811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3cb2d28f-8d98-4b01-baf2-7fdffeeea6b9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1737 microversion: 2.20 time: 0.460851 Aug 26 08:54:53.352187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 194/384] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:52 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1737 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:53.377401 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-f60824ba-d3c4-4d31-8e07-f939fa12bf71 req-b12a37f9-6b49-4571-948f-7ff73c61ca20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b667cb3-d4d2-4c6f-857f-98953e388820", "tag": "3a68c7ab-a856-4f62-ace7-5a4ee528bca2"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:54:53.391258 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-f60824ba-d3c4-4d31-8e07-f939fa12bf71 req-b12a37f9-6b49-4571-948f-7ff73c61ca20 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:53.391258 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-f60824ba-d3c4-4d31-8e07-f939fa12bf71 req-b12a37f9-6b49-4571-948f-7ff73c61ca20 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:53.391258 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-f60824ba-d3c4-4d31-8e07-f939fa12bf71 req-b12a37f9-6b49-4571-948f-7ff73c61ca20 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:53.423457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-f60824ba-d3c4-4d31-8e07-f939fa12bf71 req-b12a37f9-6b49-4571-948f-7ff73c61ca20 service nova] Creating event network-changed:3a68c7ab-a856-4f62-ace7-5a4ee528bca2 for instance 2b667cb3-d4d2-4c6f-857f-98953e388820 on hv-cinder-85236 Aug 26 08:54:53.506165 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-f60824ba-d3c4-4d31-8e07-f939fa12bf71 req-b12a37f9-6b49-4571-948f-7ff73c61ca20 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152279 Aug 26 08:54:53.511253 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 195/385] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:54:53.525005 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f8863bd2-df75-4c20-a306-13455d7af91c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:53.531193 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f8863bd2-df75-4c20-a306-13455d7af91c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:53.563911 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f8863bd2-df75-4c20-a306-13455d7af91c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:53.571056 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f8863bd2-df75-4c20-a306-13455d7af91c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:53.572057 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f8863bd2-df75-4c20-a306-13455d7af91c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:53.576545 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f8863bd2-df75-4c20-a306-13455d7af91c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:53.577369 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f8863bd2-df75-4c20-a306-13455d7af91c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:53.577953 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f8863bd2-df75-4c20-a306-13455d7af91c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:54.019243 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f8863bd2-df75-4c20-a306-13455d7af91c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:54.033519 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f8863bd2-df75-4c20-a306-13455d7af91c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 0.519879 Aug 26 08:54:54.034522 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 196/386] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:53 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:54.039953 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-130742338", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452"}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:54:55.247524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.network.neutron [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] validate_networks() for None {{(pid=132218) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:54:55.326836 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.network.neutron [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] validate_networks() for [('0095b163-b541-4b8f-a3b6-64656b6e47e8', None, None, None, None, None)] {{(pid=132217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:54:55.677889 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Flavor limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:54:55.678310 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Image limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:54:55.678781 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Flavor pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:54:55.679839 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Image pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:54:55.679839 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:54:55.692548 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:55.693040 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:55.696856 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:55.697724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:55.698234 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:55.698655 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:55.707800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=100 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:55.722949 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Getting quotas for project d9c2937d8e1243c185dab8e97f0a6e90. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:54:55.728737 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Getting quotas for user 3d3ea95f39e24567af6f1be8f7e2a60b and project d9c2937d8e1243c185dab8e97f0a6e90. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:54:55.748178 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Going to run 1 instances... {{(pid=132218) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:54:55.753034 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132218) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:54:55.756529 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:54:55.829426 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-44046ee5-5e7b-4016-a089-97f254532651 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.793529 Aug 26 08:54:55.830375 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 197/387] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:54:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 08:54:55.836394 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4b69a842-a7b2-4545-a19f-ff1363d3481a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:55.837715 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4b69a842-a7b2-4545-a19f-ff1363d3481a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:55.848160 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b69a842-a7b2-4545-a19f-ff1363d3481a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:55.848942 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b69a842-a7b2-4545-a19f-ff1363d3481a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:55.849569 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b69a842-a7b2-4545-a19f-ff1363d3481a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:55.850552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b69a842-a7b2-4545-a19f-ff1363d3481a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:55.852489 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b69a842-a7b2-4545-a19f-ff1363d3481a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:55.856855 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b69a842-a7b2-4545-a19f-ff1363d3481a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:56.174927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4b69a842-a7b2-4545-a19f-ff1363d3481a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:56.191214 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4b69a842-a7b2-4545-a19f-ff1363d3481a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:56.193935 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4b69a842-a7b2-4545-a19f-ff1363d3481a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:56.195627 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4b69a842-a7b2-4545-a19f-ff1363d3481a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1737 microversion: 2.20 time: 0.364042 Aug 26 08:54:56.196598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 198/388] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:55 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1737 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:56.211169 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-69c5ea02-3277-4b46-a1e4-b798b02296bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:56.226200 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Flavor limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:54:56.227254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Image limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:54:56.232470 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-69c5ea02-3277-4b46-a1e4-b798b02296bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:56.236022 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Flavor pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:54:56.236826 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Image pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:54:56.237319 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:54:56.254230 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69c5ea02-3277-4b46-a1e4-b798b02296bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:56.256900 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69c5ea02-3277-4b46-a1e4-b798b02296bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:56.258657 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69c5ea02-3277-4b46-a1e4-b798b02296bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:56.261180 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:56.261774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:56.262503 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:56.262706 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69c5ea02-3277-4b46-a1e4-b798b02296bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:56.264714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69c5ea02-3277-4b46-a1e4-b798b02296bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:56.265311 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:56.266068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:56.266935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:56.268613 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69c5ea02-3277-4b46-a1e4-b798b02296bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:56.298708 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Getting quotas for project 01d9fa7bc7124476aa295e69b120becd. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:54:56.305770 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Getting quotas for user 3aced0ed17b946f9961d87a1d4446c37 and project 01d9fa7bc7124476aa295e69b120becd. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:54:56.325302 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Going to run 1 instances... {{(pid=132217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:54:56.328771 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:54:56.459316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e4171349-0ab2-477f-84ad-1575f5518203 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.656164 Aug 26 08:54:56.463151 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 191/389] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:54:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 3661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 08:54:56.514723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-49263206-c5eb-41e1-8ab8-7804235f3577 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:56.515916 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-49263206-c5eb-41e1-8ab8-7804235f3577 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:56.808663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-69c5ea02-3277-4b46-a1e4-b798b02296bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:56.821490 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-69c5ea02-3277-4b46-a1e4-b798b02296bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 0.622656 Aug 26 08:54:56.824205 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 199/390] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:56 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:56.831061 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-362439bf-e9e8-4032-9c9a-1d101fe3f92b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:56.831952 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-362439bf-e9e8-4032-9c9a-1d101fe3f92b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:56.917255 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-362439bf-e9e8-4032-9c9a-1d101fe3f92b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:56.927511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-362439bf-e9e8-4032-9c9a-1d101fe3f92b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1244 microversion: 2.1 time: 0.101393 Aug 26 08:54:56.929066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 200/391] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:56 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1244 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:57.020629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-49263206-c5eb-41e1-8ab8-7804235f3577 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:57.032415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-49263206-c5eb-41e1-8ab8-7804235f3577 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1214 microversion: 2.1 time: 0.539978 Aug 26 08:54:57.033429 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 192/392] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:56 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1214 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:57.232579 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-94c13a5e-56b5-4dcd-b8dc-b637e899f9a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:57.233886 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-94c13a5e-56b5-4dcd-b8dc-b637e899f9a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:57.266924 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-94c13a5e-56b5-4dcd-b8dc-b637e899f9a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:57.267880 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-94c13a5e-56b5-4dcd-b8dc-b637e899f9a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:57.272480 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-94c13a5e-56b5-4dcd-b8dc-b637e899f9a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:57.282868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-94c13a5e-56b5-4dcd-b8dc-b637e899f9a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:57.284397 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-94c13a5e-56b5-4dcd-b8dc-b637e899f9a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:57.285408 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-94c13a5e-56b5-4dcd-b8dc-b637e899f9a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:57.645912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-94c13a5e-56b5-4dcd-b8dc-b637e899f9a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:57.663679 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-94c13a5e-56b5-4dcd-b8dc-b637e899f9a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:57.665868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-94c13a5e-56b5-4dcd-b8dc-b637e899f9a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:57.667595 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-94c13a5e-56b5-4dcd-b8dc-b637e899f9a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1719 microversion: 2.20 time: 0.446141 Aug 26 08:54:57.669292 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 201/393] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:57 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1719 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:57.850033 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-37bf5e9c-3f1c-46a5-8d85-67d0667d0b30 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:57.853076 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-37bf5e9c-3f1c-46a5-8d85-67d0667d0b30 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:57.863237 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37bf5e9c-3f1c-46a5-8d85-67d0667d0b30 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:57.863951 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37bf5e9c-3f1c-46a5-8d85-67d0667d0b30 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:57.865156 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37bf5e9c-3f1c-46a5-8d85-67d0667d0b30 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:57.866199 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37bf5e9c-3f1c-46a5-8d85-67d0667d0b30 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:57.866747 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37bf5e9c-3f1c-46a5-8d85-67d0667d0b30 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:57.867338 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37bf5e9c-3f1c-46a5-8d85-67d0667d0b30 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:57.957126 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-446b9b45-f04e-4b07-ad33-180e051d8c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:57.957776 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-446b9b45-f04e-4b07-ad33-180e051d8c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:57.974568 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-446b9b45-f04e-4b07-ad33-180e051d8c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:57.975952 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-446b9b45-f04e-4b07-ad33-180e051d8c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:57.977187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-446b9b45-f04e-4b07-ad33-180e051d8c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:57.980553 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-446b9b45-f04e-4b07-ad33-180e051d8c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:57.983183 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-446b9b45-f04e-4b07-ad33-180e051d8c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:57.984829 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-446b9b45-f04e-4b07-ad33-180e051d8c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:58.110598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-446b9b45-f04e-4b07-ad33-180e051d8c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:58.126292 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-446b9b45-f04e-4b07-ad33-180e051d8c56 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1296 microversion: 2.1 time: 0.176821 Aug 26 08:54:58.145707 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 202/394] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:57 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1296 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:58.154009 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ffb7c569-ef40-405c-a6a7-cf1f6d0a0d67 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:58.155707 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ffb7c569-ef40-405c-a6a7-cf1f6d0a0d67 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:58.164562 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ffb7c569-ef40-405c-a6a7-cf1f6d0a0d67 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:58.165655 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ffb7c569-ef40-405c-a6a7-cf1f6d0a0d67 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:58.166479 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ffb7c569-ef40-405c-a6a7-cf1f6d0a0d67 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:58.167742 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ffb7c569-ef40-405c-a6a7-cf1f6d0a0d67 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:58.168730 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ffb7c569-ef40-405c-a6a7-cf1f6d0a0d67 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:58.169473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ffb7c569-ef40-405c-a6a7-cf1f6d0a0d67 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:58.253575 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-37bf5e9c-3f1c-46a5-8d85-67d0667d0b30 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:58.271351 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-37bf5e9c-3f1c-46a5-8d85-67d0667d0b30 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 0.427763 Aug 26 08:54:58.271958 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ffb7c569-ef40-405c-a6a7-cf1f6d0a0d67 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:58.284081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ffb7c569-ef40-405c-a6a7-cf1f6d0a0d67 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1266 microversion: 2.1 time: 0.136797 Aug 26 08:54:58.284356 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 193/395] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:57 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:54:58.285385 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 203/396] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:58 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:58.718948 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d368c403-ebd7-4d2a-a98a-d128d6131f71 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:58.721933 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d368c403-ebd7-4d2a-a98a-d128d6131f71 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:58.732916 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d368c403-ebd7-4d2a-a98a-d128d6131f71 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:58.733637 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d368c403-ebd7-4d2a-a98a-d128d6131f71 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:58.734193 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d368c403-ebd7-4d2a-a98a-d128d6131f71 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:58.735228 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d368c403-ebd7-4d2a-a98a-d128d6131f71 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:58.735896 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d368c403-ebd7-4d2a-a98a-d128d6131f71 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:58.736458 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d368c403-ebd7-4d2a-a98a-d128d6131f71 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:59.023727 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d368c403-ebd7-4d2a-a98a-d128d6131f71 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:59.035744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d368c403-ebd7-4d2a-a98a-d128d6131f71 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:59.037639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d368c403-ebd7-4d2a-a98a-d128d6131f71 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:59.039398 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d368c403-ebd7-4d2a-a98a-d128d6131f71 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1719 microversion: 2.20 time: 0.324517 Aug 26 08:54:59.039971 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 194/397] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:54:58 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1719 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:54:59.154448 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d8173945-bdbf-4e75-9ba9-bde47efcb5b6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:59.155648 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d8173945-bdbf-4e75-9ba9-bde47efcb5b6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:59.166010 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d8173945-bdbf-4e75-9ba9-bde47efcb5b6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:59.166546 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d8173945-bdbf-4e75-9ba9-bde47efcb5b6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:59.167816 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d8173945-bdbf-4e75-9ba9-bde47efcb5b6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:59.167816 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d8173945-bdbf-4e75-9ba9-bde47efcb5b6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:59.169158 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d8173945-bdbf-4e75-9ba9-bde47efcb5b6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:59.169158 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d8173945-bdbf-4e75-9ba9-bde47efcb5b6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:59.279153 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d8173945-bdbf-4e75-9ba9-bde47efcb5b6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:59.295178 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d8173945-bdbf-4e75-9ba9-bde47efcb5b6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1296 microversion: 2.1 time: 0.145571 Aug 26 08:54:59.299912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 204/398] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:59 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1296 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:54:59.316820 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6ab47ea2-7620-488d-b454-a03dbe5ea808 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:59.318209 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6ab47ea2-7620-488d-b454-a03dbe5ea808 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:59.334330 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c5ff2f6b-b42a-4bc0-a4ef-560e3524af5e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:54:59.335962 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c5ff2f6b-b42a-4bc0-a4ef-560e3524af5e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:54:59.343931 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ab47ea2-7620-488d-b454-a03dbe5ea808 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:59.345268 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ab47ea2-7620-488d-b454-a03dbe5ea808 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:59.346382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ab47ea2-7620-488d-b454-a03dbe5ea808 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:59.347447 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ab47ea2-7620-488d-b454-a03dbe5ea808 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:59.348214 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ab47ea2-7620-488d-b454-a03dbe5ea808 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:59.348711 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ab47ea2-7620-488d-b454-a03dbe5ea808 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:59.350268 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c5ff2f6b-b42a-4bc0-a4ef-560e3524af5e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:59.351398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c5ff2f6b-b42a-4bc0-a4ef-560e3524af5e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:59.352763 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c5ff2f6b-b42a-4bc0-a4ef-560e3524af5e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:59.354123 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c5ff2f6b-b42a-4bc0-a4ef-560e3524af5e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:54:59.355122 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c5ff2f6b-b42a-4bc0-a4ef-560e3524af5e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:54:59.355960 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c5ff2f6b-b42a-4bc0-a4ef-560e3524af5e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:54:59.458374 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c5ff2f6b-b42a-4bc0-a4ef-560e3524af5e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:59.485698 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c5ff2f6b-b42a-4bc0-a4ef-560e3524af5e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1274 microversion: 2.1 time: 0.169874 Aug 26 08:54:59.486644 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 205/399] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:59 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1274 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:54:59.610072 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6ab47ea2-7620-488d-b454-a03dbe5ea808 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:54:59.625265 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6ab47ea2-7620-488d-b454-a03dbe5ea808 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 0.321217 Aug 26 08:54:59.627841 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 195/400] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:54:59 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:00.068352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8577a36e-9ad8-489e-a42f-219716979851 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:00.068352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8577a36e-9ad8-489e-a42f-219716979851 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:00.077608 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8577a36e-9ad8-489e-a42f-219716979851 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:00.078109 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8577a36e-9ad8-489e-a42f-219716979851 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:00.079411 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8577a36e-9ad8-489e-a42f-219716979851 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:00.080185 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8577a36e-9ad8-489e-a42f-219716979851 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:00.080638 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8577a36e-9ad8-489e-a42f-219716979851 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:00.081065 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8577a36e-9ad8-489e-a42f-219716979851 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:00.292345 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8577a36e-9ad8-489e-a42f-219716979851 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:00.302347 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8577a36e-9ad8-489e-a42f-219716979851 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:00.303621 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8577a36e-9ad8-489e-a42f-219716979851 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:00.305018 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8577a36e-9ad8-489e-a42f-219716979851 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1719 microversion: 2.20 time: 0.241966 Aug 26 08:55:00.305744 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 206/401] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:00 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1719 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:00.344769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c4e49b02-a78e-40b7-acfc-8a19490faf9f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:00.345504 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c4e49b02-a78e-40b7-acfc-8a19490faf9f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:00.355701 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c4e49b02-a78e-40b7-acfc-8a19490faf9f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:00.356494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c4e49b02-a78e-40b7-acfc-8a19490faf9f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:00.357209 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c4e49b02-a78e-40b7-acfc-8a19490faf9f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:00.358228 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c4e49b02-a78e-40b7-acfc-8a19490faf9f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:00.358844 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c4e49b02-a78e-40b7-acfc-8a19490faf9f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:00.359557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c4e49b02-a78e-40b7-acfc-8a19490faf9f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:00.438803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c4e49b02-a78e-40b7-acfc-8a19490faf9f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:00.441997 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:00.449144 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c4e49b02-a78e-40b7-acfc-8a19490faf9f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1296 microversion: 2.1 time: 0.110457 Aug 26 08:55:00.449816 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 196/402] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:00 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1296 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:00.520265 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-86bed601-b430-4c8a-8a1d-d028a4688100 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:00.521031 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-86bed601-b430-4c8a-8a1d-d028a4688100 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:00.528264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-86bed601-b430-4c8a-8a1d-d028a4688100 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:00.528748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-86bed601-b430-4c8a-8a1d-d028a4688100 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:00.529191 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-86bed601-b430-4c8a-8a1d-d028a4688100 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:00.529892 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-86bed601-b430-4c8a-8a1d-d028a4688100 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:00.530327 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-86bed601-b430-4c8a-8a1d-d028a4688100 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:00.530738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-86bed601-b430-4c8a-8a1d-d028a4688100 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:00.618301 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-86bed601-b430-4c8a-8a1d-d028a4688100 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:00.628406 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-86bed601-b430-4c8a-8a1d-d028a4688100 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1274 microversion: 2.1 time: 0.113791 Aug 26 08:55:00.629099 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 207/403] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:00 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:00.652770 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-f14a96e3-aa33-4874-ab03-7be3abdf948a req-6b9c557c-05b4-470a-8eb7-e3e3d4c27a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0d2d4-3218-426b-a548-91c5891780fa", "name": "network-vif-unplugged", "status": "completed", "tag": "61d58bf1-2d6c-4df7-8638-a30df721d2e9"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:00.656690 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7d94f164-be63-477e-87da-150b371bd16f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:00.657608 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-7d94f164-be63-477e-87da-150b371bd16f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:00.672899 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7d94f164-be63-477e-87da-150b371bd16f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:00.673572 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7d94f164-be63-477e-87da-150b371bd16f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:00.674305 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7d94f164-be63-477e-87da-150b371bd16f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:00.674955 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-f14a96e3-aa33-4874-ab03-7be3abdf948a req-6b9c557c-05b4-470a-8eb7-e3e3d4c27a1d service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:00.675210 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7d94f164-be63-477e-87da-150b371bd16f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:00.675792 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-f14a96e3-aa33-4874-ab03-7be3abdf948a req-6b9c557c-05b4-470a-8eb7-e3e3d4c27a1d service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:00.676061 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7d94f164-be63-477e-87da-150b371bd16f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:00.676274 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7d94f164-be63-477e-87da-150b371bd16f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:00.677134 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-f14a96e3-aa33-4874-ab03-7be3abdf948a req-6b9c557c-05b4-470a-8eb7-e3e3d4c27a1d service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:00.699658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-f14a96e3-aa33-4874-ab03-7be3abdf948a req-6b9c557c-05b4-470a-8eb7-e3e3d4c27a1d service nova] Creating event network-vif-unplugged:61d58bf1-2d6c-4df7-8638-a30df721d2e9 for instance 8de0d2d4-3218-426b-a548-91c5891780fa on hv-cinder-85236 Aug 26 08:55:00.710026 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-f14a96e3-aa33-4874-ab03-7be3abdf948a req-6b9c557c-05b4-470a-8eb7-e3e3d4c27a1d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064566 Aug 26 08:55:00.712079 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 197/404] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:55:00.851932 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-7d94f164-be63-477e-87da-150b371bd16f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:00.861271 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7d94f164-be63-477e-87da-150b371bd16f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 0.209199 Aug 26 08:55:00.861854 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 208/405] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:00 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:01.331831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-60ca1c9d-c384-46f5-a669-46afa7cebe36 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:01.332546 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-60ca1c9d-c384-46f5-a669-46afa7cebe36 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:01.342087 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-60ca1c9d-c384-46f5-a669-46afa7cebe36 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:01.342985 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-60ca1c9d-c384-46f5-a669-46afa7cebe36 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:01.343778 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-60ca1c9d-c384-46f5-a669-46afa7cebe36 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:01.344992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-60ca1c9d-c384-46f5-a669-46afa7cebe36 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:01.345772 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-60ca1c9d-c384-46f5-a669-46afa7cebe36 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:01.346564 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-60ca1c9d-c384-46f5-a669-46afa7cebe36 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:01.483283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f33b7264-25dd-4a19-8d6a-f7a4bbeb846e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:01.484291 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f33b7264-25dd-4a19-8d6a-f7a4bbeb846e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:01.503984 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f33b7264-25dd-4a19-8d6a-f7a4bbeb846e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:01.505324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f33b7264-25dd-4a19-8d6a-f7a4bbeb846e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:01.506414 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f33b7264-25dd-4a19-8d6a-f7a4bbeb846e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:01.508203 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f33b7264-25dd-4a19-8d6a-f7a4bbeb846e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:01.509381 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f33b7264-25dd-4a19-8d6a-f7a4bbeb846e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:01.510924 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f33b7264-25dd-4a19-8d6a-f7a4bbeb846e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:01.584116 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-60ca1c9d-c384-46f5-a669-46afa7cebe36 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:01.594773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-60ca1c9d-c384-46f5-a669-46afa7cebe36 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:01.596457 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-60ca1c9d-c384-46f5-a669-46afa7cebe36 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:01.597951 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-60ca1c9d-c384-46f5-a669-46afa7cebe36 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1719 microversion: 2.20 time: 0.272460 Aug 26 08:55:01.598517 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 198/406] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:01 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1719 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:01.637626 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f33b7264-25dd-4a19-8d6a-f7a4bbeb846e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:01.646993 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f33b7264-25dd-4a19-8d6a-f7a4bbeb846e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1296 microversion: 2.1 time: 0.170601 Aug 26 08:55:01.647777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 209/407] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:01 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1296 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:01.660050 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ff54bbbc-c415-48a2-8ed2-5dc4d4ac4765 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:01.661103 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ff54bbbc-c415-48a2-8ed2-5dc4d4ac4765 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:01.671457 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ff54bbbc-c415-48a2-8ed2-5dc4d4ac4765 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:01.672287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ff54bbbc-c415-48a2-8ed2-5dc4d4ac4765 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:01.673034 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ff54bbbc-c415-48a2-8ed2-5dc4d4ac4765 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:01.674514 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ff54bbbc-c415-48a2-8ed2-5dc4d4ac4765 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:01.675332 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ff54bbbc-c415-48a2-8ed2-5dc4d4ac4765 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:01.676117 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ff54bbbc-c415-48a2-8ed2-5dc4d4ac4765 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:01.774787 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ff54bbbc-c415-48a2-8ed2-5dc4d4ac4765 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:01.786361 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ff54bbbc-c415-48a2-8ed2-5dc4d4ac4765 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1274 microversion: 2.1 time: 0.133275 Aug 26 08:55:01.787133 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 199/408] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:01 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:01.887340 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f0287124-aff7-45da-87bf-760b129f19cc tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:01.888373 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f0287124-aff7-45da-87bf-760b129f19cc tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:01.897901 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0287124-aff7-45da-87bf-760b129f19cc tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:01.898726 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0287124-aff7-45da-87bf-760b129f19cc tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:01.899518 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0287124-aff7-45da-87bf-760b129f19cc tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:01.900679 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0287124-aff7-45da-87bf-760b129f19cc tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:01.901414 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0287124-aff7-45da-87bf-760b129f19cc tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:01.901969 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0287124-aff7-45da-87bf-760b129f19cc tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:02.323897 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f0287124-aff7-45da-87bf-760b129f19cc tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:02.335127 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f0287124-aff7-45da-87bf-760b129f19cc tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 0.454579 Aug 26 08:55:02.343187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 210/409] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:01 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:02.634530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d376de02-3919-44a3-a1b6-f6ca11ad0804 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:02.635407 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d376de02-3919-44a3-a1b6-f6ca11ad0804 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:02.642481 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d376de02-3919-44a3-a1b6-f6ca11ad0804 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:02.643139 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d376de02-3919-44a3-a1b6-f6ca11ad0804 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:02.643685 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d376de02-3919-44a3-a1b6-f6ca11ad0804 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:02.644528 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d376de02-3919-44a3-a1b6-f6ca11ad0804 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:02.645095 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d376de02-3919-44a3-a1b6-f6ca11ad0804 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:02.645617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d376de02-3919-44a3-a1b6-f6ca11ad0804 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:02.670440 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-dc59b1f3-b1a2-44bd-9f32-6aafe1660d31 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:02.671387 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-dc59b1f3-b1a2-44bd-9f32-6aafe1660d31 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:02.678602 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc59b1f3-b1a2-44bd-9f32-6aafe1660d31 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:02.679127 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc59b1f3-b1a2-44bd-9f32-6aafe1660d31 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:02.679684 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc59b1f3-b1a2-44bd-9f32-6aafe1660d31 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:02.680475 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc59b1f3-b1a2-44bd-9f32-6aafe1660d31 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:02.680928 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc59b1f3-b1a2-44bd-9f32-6aafe1660d31 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:02.681351 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc59b1f3-b1a2-44bd-9f32-6aafe1660d31 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:02.761289 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-dc59b1f3-b1a2-44bd-9f32-6aafe1660d31 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:02.773155 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-dc59b1f3-b1a2-44bd-9f32-6aafe1660d31 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1296 microversion: 2.1 time: 0.107148 Aug 26 08:55:02.774194 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 211/410] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:02 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:02.820902 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0697df22-c4d7-4783-9832-011683fd0c85 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:02.821526 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0697df22-c4d7-4783-9832-011683fd0c85 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:02.829059 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0697df22-c4d7-4783-9832-011683fd0c85 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:02.829534 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0697df22-c4d7-4783-9832-011683fd0c85 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:02.830095 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0697df22-c4d7-4783-9832-011683fd0c85 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:02.830845 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0697df22-c4d7-4783-9832-011683fd0c85 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:02.831426 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0697df22-c4d7-4783-9832-011683fd0c85 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:02.831847 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0697df22-c4d7-4783-9832-011683fd0c85 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:02.843251 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d376de02-3919-44a3-a1b6-f6ca11ad0804 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:02.854148 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d376de02-3919-44a3-a1b6-f6ca11ad0804 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:02.856412 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d376de02-3919-44a3-a1b6-f6ca11ad0804 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:02.857982 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d376de02-3919-44a3-a1b6-f6ca11ad0804 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1719 microversion: 2.20 time: 0.227800 Aug 26 08:55:02.859071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 200/411] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:02 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1719 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:02.922589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0697df22-c4d7-4783-9832-011683fd0c85 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:02.933013 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0697df22-c4d7-4783-9832-011683fd0c85 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1284 microversion: 2.1 time: 0.116294 Aug 26 08:55:02.933607 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 212/412] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:02 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:03.363918 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4b914dd9-0922-46bc-8930-68b4de1c6e7e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:03.364433 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4b914dd9-0922-46bc-8930-68b4de1c6e7e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:03.372460 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4b914dd9-0922-46bc-8930-68b4de1c6e7e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:03.372977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4b914dd9-0922-46bc-8930-68b4de1c6e7e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:03.373482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4b914dd9-0922-46bc-8930-68b4de1c6e7e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:03.374192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4b914dd9-0922-46bc-8930-68b4de1c6e7e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:03.374823 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4b914dd9-0922-46bc-8930-68b4de1c6e7e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:03.375414 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4b914dd9-0922-46bc-8930-68b4de1c6e7e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:03.542857 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-4b914dd9-0922-46bc-8930-68b4de1c6e7e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:03.552026 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4b914dd9-0922-46bc-8930-68b4de1c6e7e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 0.194300 Aug 26 08:55:03.552707 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 201/413] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:03 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:03.817933 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b5a4fe9d-dcf2-4392-8c4d-0447b5546a18 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:03.823314 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b5a4fe9d-dcf2-4392-8c4d-0447b5546a18 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:03.847835 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b5a4fe9d-dcf2-4392-8c4d-0447b5546a18 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:03.849030 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b5a4fe9d-dcf2-4392-8c4d-0447b5546a18 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:03.850127 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b5a4fe9d-dcf2-4392-8c4d-0447b5546a18 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:03.854349 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b5a4fe9d-dcf2-4392-8c4d-0447b5546a18 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:03.856826 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b5a4fe9d-dcf2-4392-8c4d-0447b5546a18 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:03.857651 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b5a4fe9d-dcf2-4392-8c4d-0447b5546a18 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:03.890407 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0cfb01f9-f33c-4ad8-9a50-6ee1f6474d44 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:03.893456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-0cfb01f9-f33c-4ad8-9a50-6ee1f6474d44 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:03.902141 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0cfb01f9-f33c-4ad8-9a50-6ee1f6474d44 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:03.903327 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0cfb01f9-f33c-4ad8-9a50-6ee1f6474d44 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:03.903996 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0cfb01f9-f33c-4ad8-9a50-6ee1f6474d44 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:03.905480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0cfb01f9-f33c-4ad8-9a50-6ee1f6474d44 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:03.905480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0cfb01f9-f33c-4ad8-9a50-6ee1f6474d44 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:03.905480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0cfb01f9-f33c-4ad8-9a50-6ee1f6474d44 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:03.990673 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b5a4fe9d-dcf2-4392-8c4d-0447b5546a18 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:04.001924 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b5a4fe9d-dcf2-4392-8c4d-0447b5546a18 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1296 microversion: 2.1 time: 0.197062 Aug 26 08:55:04.002815 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 213/414] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:03 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1296 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:04.010645 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8d93152c-2712-4eeb-b787-925cff8dd27d tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:04.011838 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8d93152c-2712-4eeb-b787-925cff8dd27d tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:04.019318 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8d93152c-2712-4eeb-b787-925cff8dd27d tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:04.020286 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8d93152c-2712-4eeb-b787-925cff8dd27d tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:04.020981 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8d93152c-2712-4eeb-b787-925cff8dd27d tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:04.022234 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8d93152c-2712-4eeb-b787-925cff8dd27d tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:04.023057 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8d93152c-2712-4eeb-b787-925cff8dd27d tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:04.023543 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8d93152c-2712-4eeb-b787-925cff8dd27d tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:04.123805 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8d93152c-2712-4eeb-b787-925cff8dd27d tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:04.140060 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8d93152c-2712-4eeb-b787-925cff8dd27d tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1272 microversion: 2.1 time: 0.134976 Aug 26 08:55:04.141379 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 214/415] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:04 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:04.356215 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0cfb01f9-f33c-4ad8-9a50-6ee1f6474d44 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:04.369251 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0cfb01f9-f33c-4ad8-9a50-6ee1f6474d44 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:04.371772 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0cfb01f9-f33c-4ad8-9a50-6ee1f6474d44 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:04.374062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-0cfb01f9-f33c-4ad8-9a50-6ee1f6474d44 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1722 microversion: 2.20 time: 0.490146 Aug 26 08:55:04.375248 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 202/416] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:03 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1722 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:55:04.399487 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-73761629-4b77-4704-81d2-810a629be992 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bf255ff-b9a6-45ff-86b7-b68318d0d176"}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:04.403007 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-73761629-4b77-4704-81d2-810a629be992 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:04.411379 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-73761629-4b77-4704-81d2-810a629be992 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:04.411950 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-73761629-4b77-4704-81d2-810a629be992 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:04.412549 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-73761629-4b77-4704-81d2-810a629be992 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:04.413456 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-73761629-4b77-4704-81d2-810a629be992 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:04.413966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-73761629-4b77-4704-81d2-810a629be992 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:04.414636 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-73761629-4b77-4704-81d2-810a629be992 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:04.434063 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=100 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:04.579810 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-bd1358a6-ea5f-495a-85e6-f66d46acf9bf tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:04.581183 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-bd1358a6-ea5f-495a-85e6-f66d46acf9bf tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:04.595634 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bd1358a6-ea5f-495a-85e6-f66d46acf9bf tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:04.596507 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bd1358a6-ea5f-495a-85e6-f66d46acf9bf tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:04.597065 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bd1358a6-ea5f-495a-85e6-f66d46acf9bf tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:04.597957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bd1358a6-ea5f-495a-85e6-f66d46acf9bf tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:04.598768 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bd1358a6-ea5f-495a-85e6-f66d46acf9bf tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:04.599761 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bd1358a6-ea5f-495a-85e6-f66d46acf9bf tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:04.912907 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-73761629-4b77-4704-81d2-810a629be992 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "POST /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.510659 Aug 26 08:55:04.912907 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 215/417] 10.222.0.71 () {62 vars in 1364 bytes} [Fri Aug 26 08:55:04 2022] POST /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments => generated 188 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:55:05.039661 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-59cea34b-948f-42a7-9665-7a078c7efe5e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:05.039661 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-59cea34b-948f-42a7-9665-7a078c7efe5e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:05.073517 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-59cea34b-948f-42a7-9665-7a078c7efe5e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:05.074516 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-59cea34b-948f-42a7-9665-7a078c7efe5e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:05.075436 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-59cea34b-948f-42a7-9665-7a078c7efe5e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:05.077133 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-59cea34b-948f-42a7-9665-7a078c7efe5e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:05.078246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-59cea34b-948f-42a7-9665-7a078c7efe5e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:05.079963 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-59cea34b-948f-42a7-9665-7a078c7efe5e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:05.128360 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bd1358a6-ea5f-495a-85e6-f66d46acf9bf tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:05.148422 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-bd1358a6-ea5f-495a-85e6-f66d46acf9bf tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 0.577133 Aug 26 08:55:05.163489 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 203/418] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:04 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:05.163489 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3c100317-1816-41ca-a13d-5e4b66b0187f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:05.163489 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3c100317-1816-41ca-a13d-5e4b66b0187f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:05.191082 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3c100317-1816-41ca-a13d-5e4b66b0187f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:05.193909 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3c100317-1816-41ca-a13d-5e4b66b0187f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:05.195000 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3c100317-1816-41ca-a13d-5e4b66b0187f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:05.197035 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3c100317-1816-41ca-a13d-5e4b66b0187f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:05.198641 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3c100317-1816-41ca-a13d-5e4b66b0187f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:05.200052 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3c100317-1816-41ca-a13d-5e4b66b0187f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:05.224974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-59cea34b-948f-42a7-9665-7a078c7efe5e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:05.242383 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-59cea34b-948f-42a7-9665-7a078c7efe5e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1302 microversion: 2.1 time: 0.214759 Aug 26 08:55:05.244226 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 216/419] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:05 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1302 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:05.252329 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-374c97ea-c6f6-4334-aaed-069c89cba9bc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:05.254587 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-374c97ea-c6f6-4334-aaed-069c89cba9bc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:05.265466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-374c97ea-c6f6-4334-aaed-069c89cba9bc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:05.266932 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-374c97ea-c6f6-4334-aaed-069c89cba9bc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:05.267828 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-374c97ea-c6f6-4334-aaed-069c89cba9bc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:05.268983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-374c97ea-c6f6-4334-aaed-069c89cba9bc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:05.269865 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-374c97ea-c6f6-4334-aaed-069c89cba9bc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:05.270445 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-374c97ea-c6f6-4334-aaed-069c89cba9bc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:05.309591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3c100317-1816-41ca-a13d-5e4b66b0187f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132217) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 08:55:05.393598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-374c97ea-c6f6-4334-aaed-069c89cba9bc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:05.411632 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-374c97ea-c6f6-4334-aaed-069c89cba9bc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1272 microversion: 2.1 time: 0.165535 Aug 26 08:55:05.427025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 217/420] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:05 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:05.442275 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-3c100317-1816-41ca-a13d-5e4b66b0187f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "POST /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/action" status: 202 len: 0 microversion: 2.20 time: 0.290351 Aug 26 08:55:05.447814 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 204/421] 10.222.0.71 () {62 vars in 1319 bytes} [Fri Aug 26 08:55:05 2022] POST /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:55:05.455285 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-75d6a125-e7e4-4fc7-a36e-7556452615af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:05.456087 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-75d6a125-e7e4-4fc7-a36e-7556452615af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:05.466241 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-75d6a125-e7e4-4fc7-a36e-7556452615af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:05.467137 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-75d6a125-e7e4-4fc7-a36e-7556452615af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:05.468722 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-75d6a125-e7e4-4fc7-a36e-7556452615af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:05.470260 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-75d6a125-e7e4-4fc7-a36e-7556452615af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:05.471134 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-75d6a125-e7e4-4fc7-a36e-7556452615af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:05.471866 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-75d6a125-e7e4-4fc7-a36e-7556452615af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:05.709039 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:05.753631 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-75d6a125-e7e4-4fc7-a36e-7556452615af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:05.777987 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-75d6a125-e7e4-4fc7-a36e-7556452615af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:05.782464 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-75d6a125-e7e4-4fc7-a36e-7556452615af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:05.785145 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-75d6a125-e7e4-4fc7-a36e-7556452615af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1808 microversion: 2.20 time: 0.335028 Aug 26 08:55:05.786564 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 218/422] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:05 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1808 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:06.181761 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1b5fdea2-2e01-4b36-8031-3dd98e6bdf44 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:06.182569 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1b5fdea2-2e01-4b36-8031-3dd98e6bdf44 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:06.195951 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b5fdea2-2e01-4b36-8031-3dd98e6bdf44 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:06.197175 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b5fdea2-2e01-4b36-8031-3dd98e6bdf44 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:06.199262 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b5fdea2-2e01-4b36-8031-3dd98e6bdf44 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:06.201719 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b5fdea2-2e01-4b36-8031-3dd98e6bdf44 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:06.203097 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b5fdea2-2e01-4b36-8031-3dd98e6bdf44 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:06.203682 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b5fdea2-2e01-4b36-8031-3dd98e6bdf44 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:06.268719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-aacf6141-95f3-4cfe-8944-b282219d683e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:06.269424 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-aacf6141-95f3-4cfe-8944-b282219d683e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:06.279401 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aacf6141-95f3-4cfe-8944-b282219d683e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:06.280767 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aacf6141-95f3-4cfe-8944-b282219d683e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:06.282038 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aacf6141-95f3-4cfe-8944-b282219d683e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:06.283785 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aacf6141-95f3-4cfe-8944-b282219d683e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:06.284785 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aacf6141-95f3-4cfe-8944-b282219d683e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:06.285644 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aacf6141-95f3-4cfe-8944-b282219d683e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:06.285890 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:06.513650 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-aacf6141-95f3-4cfe-8944-b282219d683e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:06.551732 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-aacf6141-95f3-4cfe-8944-b282219d683e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1302 microversion: 2.1 time: 0.287240 Aug 26 08:55:06.563293 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 219/423] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:06 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1302 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:06.571265 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-48ab1794-c110-4579-a18d-40f1011553c0 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:06.572313 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-48ab1794-c110-4579-a18d-40f1011553c0 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:06.588073 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-48ab1794-c110-4579-a18d-40f1011553c0 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:06.590266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-48ab1794-c110-4579-a18d-40f1011553c0 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:06.591420 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-48ab1794-c110-4579-a18d-40f1011553c0 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:06.592895 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-48ab1794-c110-4579-a18d-40f1011553c0 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:06.605059 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-48ab1794-c110-4579-a18d-40f1011553c0 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:06.605805 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-48ab1794-c110-4579-a18d-40f1011553c0 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:06.703542 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1b5fdea2-2e01-4b36-8031-3dd98e6bdf44 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:06.721990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1b5fdea2-2e01-4b36-8031-3dd98e6bdf44 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 0.545056 Aug 26 08:55:06.723644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 205/424] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:06 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:06.819480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-00dd0496-17da-44b9-9136-d85395134dda tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:06.821701 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-00dd0496-17da-44b9-9136-d85395134dda tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:06.844219 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00dd0496-17da-44b9-9136-d85395134dda tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:06.846297 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00dd0496-17da-44b9-9136-d85395134dda tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:06.847480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00dd0496-17da-44b9-9136-d85395134dda tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:06.849662 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00dd0496-17da-44b9-9136-d85395134dda tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:06.850419 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00dd0496-17da-44b9-9136-d85395134dda tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:06.853331 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00dd0496-17da-44b9-9136-d85395134dda tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:06.923751 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=8 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:07.026641 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=18 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:07.058106 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-48ab1794-c110-4579-a18d-40f1011553c0 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:07.072482 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-48ab1794-c110-4579-a18d-40f1011553c0 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.507828 Aug 26 08:55:07.074412 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 220/425] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:06 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:07.506325 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-00dd0496-17da-44b9-9136-d85395134dda tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:07.528910 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-00dd0496-17da-44b9-9136-d85395134dda tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:07.533430 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-00dd0496-17da-44b9-9136-d85395134dda tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:07.537178 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-00dd0496-17da-44b9-9136-d85395134dda tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1748 microversion: 2.20 time: 0.727458 Aug 26 08:55:07.538182 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 206/426] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:06 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1748 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:55:07.574155 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4c7c97c9-8474-4681-9c3c-6bcd9a81382e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:07.575005 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4c7c97c9-8474-4681-9c3c-6bcd9a81382e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:07.582668 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c7c97c9-8474-4681-9c3c-6bcd9a81382e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:07.589966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c7c97c9-8474-4681-9c3c-6bcd9a81382e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:07.590764 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c7c97c9-8474-4681-9c3c-6bcd9a81382e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:07.591872 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c7c97c9-8474-4681-9c3c-6bcd9a81382e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:07.592541 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c7c97c9-8474-4681-9c3c-6bcd9a81382e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:07.592936 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4c7c97c9-8474-4681-9c3c-6bcd9a81382e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:07.761344 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6d08b190-9b9e-421c-86fa-fbd495d5e251 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:07.768331 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6d08b190-9b9e-421c-86fa-fbd495d5e251 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:07.789684 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d08b190-9b9e-421c-86fa-fbd495d5e251 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:07.790467 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d08b190-9b9e-421c-86fa-fbd495d5e251 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:07.791155 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d08b190-9b9e-421c-86fa-fbd495d5e251 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:07.792298 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d08b190-9b9e-421c-86fa-fbd495d5e251 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:07.793020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d08b190-9b9e-421c-86fa-fbd495d5e251 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:07.793695 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d08b190-9b9e-421c-86fa-fbd495d5e251 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:07.897971 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4c7c97c9-8474-4681-9c3c-6bcd9a81382e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:07.913719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4c7c97c9-8474-4681-9c3c-6bcd9a81382e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.343103 Aug 26 08:55:07.951018 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 221/427] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:07 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:08.113202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2692bf1d-451c-497e-aefe-fd5b71541fcd tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:08.114975 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2692bf1d-451c-497e-aefe-fd5b71541fcd tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:08.130735 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2692bf1d-451c-497e-aefe-fd5b71541fcd tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:08.133990 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2692bf1d-451c-497e-aefe-fd5b71541fcd tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:08.135319 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2692bf1d-451c-497e-aefe-fd5b71541fcd tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:08.137107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2692bf1d-451c-497e-aefe-fd5b71541fcd tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:08.140059 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2692bf1d-451c-497e-aefe-fd5b71541fcd tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:08.142705 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2692bf1d-451c-497e-aefe-fd5b71541fcd tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:08.396453 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6d08b190-9b9e-421c-86fa-fbd495d5e251 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:08.432259 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6d08b190-9b9e-421c-86fa-fbd495d5e251 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 0.678941 Aug 26 08:55:08.433649 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 207/428] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:07 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:08.571583 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-aefa2179-c153-4b5b-9762-b01377c5eb6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:08.577930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-aefa2179-c153-4b5b-9762-b01377c5eb6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:08.606508 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aefa2179-c153-4b5b-9762-b01377c5eb6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:08.607533 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aefa2179-c153-4b5b-9762-b01377c5eb6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:08.608302 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aefa2179-c153-4b5b-9762-b01377c5eb6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:08.610215 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aefa2179-c153-4b5b-9762-b01377c5eb6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:08.611206 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aefa2179-c153-4b5b-9762-b01377c5eb6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:08.613037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aefa2179-c153-4b5b-9762-b01377c5eb6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:08.754118 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2692bf1d-451c-497e-aefe-fd5b71541fcd tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:08.774663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2692bf1d-451c-497e-aefe-fd5b71541fcd tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.679197 Aug 26 08:55:08.776495 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 222/429] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:08 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:08.972809 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5162da88-511d-4758-b33d-e0edc118ec6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:08.976353 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5162da88-511d-4758-b33d-e0edc118ec6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:09.025506 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5162da88-511d-4758-b33d-e0edc118ec6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:09.029604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5162da88-511d-4758-b33d-e0edc118ec6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:09.031402 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5162da88-511d-4758-b33d-e0edc118ec6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:09.033023 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5162da88-511d-4758-b33d-e0edc118ec6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:09.034631 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5162da88-511d-4758-b33d-e0edc118ec6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:09.035714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5162da88-511d-4758-b33d-e0edc118ec6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:09.190593 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-aefa2179-c153-4b5b-9762-b01377c5eb6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:09.221611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-aefa2179-c153-4b5b-9762-b01377c5eb6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:09.225144 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-aefa2179-c153-4b5b-9762-b01377c5eb6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:09.227184 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-aefa2179-c153-4b5b-9762-b01377c5eb6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1750 microversion: 2.20 time: 0.662514 Aug 26 08:55:09.228266 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 208/430] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:08 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1750 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:09.381530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5162da88-511d-4758-b33d-e0edc118ec6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:09.414215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5162da88-511d-4758-b33d-e0edc118ec6a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.463058 Aug 26 08:55:09.417480 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 223/431] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:08 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:09.469406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3fab09fd-0970-4d64-a979-acb170cd2684 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:09.469406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3fab09fd-0970-4d64-a979-acb170cd2684 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:09.486391 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3fab09fd-0970-4d64-a979-acb170cd2684 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:09.489919 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3fab09fd-0970-4d64-a979-acb170cd2684 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:09.490708 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3fab09fd-0970-4d64-a979-acb170cd2684 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:09.496493 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3fab09fd-0970-4d64-a979-acb170cd2684 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:09.497885 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3fab09fd-0970-4d64-a979-acb170cd2684 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:09.499214 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3fab09fd-0970-4d64-a979-acb170cd2684 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:09.612841 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-5ea64384-6e60-40b7-b416-8cf06faa1b5e req-bec38392-40dc-453e-ac89-a12e54bb9b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba6e623-d5a4-4f7f-ab8f-ede13517de39", "tag": "390693e3-15ad-42f2-a309-c1c33a1f05d7"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:09.652531 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-5ea64384-6e60-40b7-b416-8cf06faa1b5e req-bec38392-40dc-453e-ac89-a12e54bb9b59 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:09.653791 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-5ea64384-6e60-40b7-b416-8cf06faa1b5e req-bec38392-40dc-453e-ac89-a12e54bb9b59 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:09.655082 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-5ea64384-6e60-40b7-b416-8cf06faa1b5e req-bec38392-40dc-453e-ac89-a12e54bb9b59 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:09.691466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-5ea64384-6e60-40b7-b416-8cf06faa1b5e req-bec38392-40dc-453e-ac89-a12e54bb9b59 service nova] Creating event network-changed:390693e3-15ad-42f2-a309-c1c33a1f05d7 for instance 5ba6e623-d5a4-4f7f-ab8f-ede13517de39 on hv-cinder-85236 Aug 26 08:55:09.705467 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-5ea64384-6e60-40b7-b416-8cf06faa1b5e req-bec38392-40dc-453e-ac89-a12e54bb9b59 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100704 Aug 26 08:55:09.708213 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 224/432] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:55:09.812308 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c44e5d52-bfa2-4015-85de-5a9264b7e111 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:09.813547 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c44e5d52-bfa2-4015-85de-5a9264b7e111 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:09.835854 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c44e5d52-bfa2-4015-85de-5a9264b7e111 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:09.837194 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c44e5d52-bfa2-4015-85de-5a9264b7e111 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:09.837791 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c44e5d52-bfa2-4015-85de-5a9264b7e111 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:09.838780 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c44e5d52-bfa2-4015-85de-5a9264b7e111 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:09.839782 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c44e5d52-bfa2-4015-85de-5a9264b7e111 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:09.840541 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c44e5d52-bfa2-4015-85de-5a9264b7e111 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:10.195135 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3fab09fd-0970-4d64-a979-acb170cd2684 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:10.205719 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-3fab09fd-0970-4d64-a979-acb170cd2684 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 0.745944 Aug 26 08:55:10.221074 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 209/433] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:09 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:10.229581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c44e5d52-bfa2-4015-85de-5a9264b7e111 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:10.261473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c44e5d52-bfa2-4015-85de-5a9264b7e111 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.456831 Aug 26 08:55:10.267385 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 225/434] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:09 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:10.270357 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d504f298-f0e6-40c1-b481-7455396766c3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:10.271328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d504f298-f0e6-40c1-b481-7455396766c3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:10.292365 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d504f298-f0e6-40c1-b481-7455396766c3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:10.293210 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d504f298-f0e6-40c1-b481-7455396766c3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:10.294578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d504f298-f0e6-40c1-b481-7455396766c3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:10.295617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d504f298-f0e6-40c1-b481-7455396766c3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:10.296372 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d504f298-f0e6-40c1-b481-7455396766c3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:10.296951 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d504f298-f0e6-40c1-b481-7455396766c3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:10.452097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a76fda4a-1a7c-488e-8d9b-8f715991d12c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:10.455685 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a76fda4a-1a7c-488e-8d9b-8f715991d12c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:10.477608 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a76fda4a-1a7c-488e-8d9b-8f715991d12c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:10.478824 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a76fda4a-1a7c-488e-8d9b-8f715991d12c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:10.480086 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a76fda4a-1a7c-488e-8d9b-8f715991d12c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:10.481613 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a76fda4a-1a7c-488e-8d9b-8f715991d12c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:10.483025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a76fda4a-1a7c-488e-8d9b-8f715991d12c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:10.484511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a76fda4a-1a7c-488e-8d9b-8f715991d12c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:10.648976 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d504f298-f0e6-40c1-b481-7455396766c3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:10.674854 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d504f298-f0e6-40c1-b481-7455396766c3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:10.676628 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d504f298-f0e6-40c1-b481-7455396766c3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:10.678196 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d504f298-f0e6-40c1-b481-7455396766c3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.414599 Aug 26 08:55:10.679136 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 210/435] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:10 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:55:10.803775 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a76fda4a-1a7c-488e-8d9b-8f715991d12c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:10.829787 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a76fda4a-1a7c-488e-8d9b-8f715991d12c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.383763 Aug 26 08:55:10.833291 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 226/436] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:10 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:11.200330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-91c0e374-d94e-483a-ab49-a6490266551f req-484046d1-afad-4181-b16d-788394e6e453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b667cb3-d4d2-4c6f-857f-98953e388820", "name": "network-vif-plugged", "status": "completed", "tag": "3a68c7ab-a856-4f62-ace7-5a4ee528bca2"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:11.234649 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f4750314-200e-4346-a181-736d2b984b1e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:11.237197 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f4750314-200e-4346-a181-736d2b984b1e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:11.257249 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-91c0e374-d94e-483a-ab49-a6490266551f req-484046d1-afad-4181-b16d-788394e6e453 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:11.266330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-91c0e374-d94e-483a-ab49-a6490266551f req-484046d1-afad-4181-b16d-788394e6e453 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:11.272935 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f4750314-200e-4346-a181-736d2b984b1e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:11.274510 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-91c0e374-d94e-483a-ab49-a6490266551f req-484046d1-afad-4181-b16d-788394e6e453 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:11.277846 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f4750314-200e-4346-a181-736d2b984b1e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:11.285084 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f4750314-200e-4346-a181-736d2b984b1e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:11.287276 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f4750314-200e-4346-a181-736d2b984b1e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:11.291462 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f4750314-200e-4346-a181-736d2b984b1e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:11.296200 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f4750314-200e-4346-a181-736d2b984b1e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:11.346085 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-91c0e374-d94e-483a-ab49-a6490266551f req-484046d1-afad-4181-b16d-788394e6e453 service nova] Creating event network-vif-plugged:3a68c7ab-a856-4f62-ace7-5a4ee528bca2 for instance 2b667cb3-d4d2-4c6f-857f-98953e388820 on hv-cinder-85236 Aug 26 08:55:11.373681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-91c0e374-d94e-483a-ab49-a6490266551f req-484046d1-afad-4181-b16d-788394e6e453 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180131 Aug 26 08:55:11.379505 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 211/437] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:55:11.407068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-70ae5e43-930a-4dbe-82b1-b3d5565d5cda tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:11.415952 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-70ae5e43-930a-4dbe-82b1-b3d5565d5cda tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:11.456420 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-70ae5e43-930a-4dbe-82b1-b3d5565d5cda tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:11.463891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-70ae5e43-930a-4dbe-82b1-b3d5565d5cda tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:11.464966 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-70ae5e43-930a-4dbe-82b1-b3d5565d5cda tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:11.466822 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-70ae5e43-930a-4dbe-82b1-b3d5565d5cda tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:11.467907 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-70ae5e43-930a-4dbe-82b1-b3d5565d5cda tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:11.468866 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-70ae5e43-930a-4dbe-82b1-b3d5565d5cda tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:12.188369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-70ae5e43-930a-4dbe-82b1-b3d5565d5cda tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:12.203276 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-70ae5e43-930a-4dbe-82b1-b3d5565d5cda tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.820687 Aug 26 08:55:12.204583 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 212/438] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:11 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:12.213898 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-938a2950-edb2-4bf5-a9f2-b8d8d19d6762 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:12.215117 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-938a2950-edb2-4bf5-a9f2-b8d8d19d6762 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:12.226779 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-938a2950-edb2-4bf5-a9f2-b8d8d19d6762 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:12.227735 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-938a2950-edb2-4bf5-a9f2-b8d8d19d6762 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:12.228697 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-938a2950-edb2-4bf5-a9f2-b8d8d19d6762 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:12.231978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-938a2950-edb2-4bf5-a9f2-b8d8d19d6762 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:12.234494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-938a2950-edb2-4bf5-a9f2-b8d8d19d6762 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:12.234494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-938a2950-edb2-4bf5-a9f2-b8d8d19d6762 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:12.607520 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-938a2950-edb2-4bf5-a9f2-b8d8d19d6762 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:12.610265 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:12.617327 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f4750314-200e-4346-a181-736d2b984b1e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:12.629182 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-938a2950-edb2-4bf5-a9f2-b8d8d19d6762 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:12.632381 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-938a2950-edb2-4bf5-a9f2-b8d8d19d6762 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:12.634640 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-938a2950-edb2-4bf5-a9f2-b8d8d19d6762 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.428365 Aug 26 08:55:12.637319 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 213/439] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:12 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:12.638185 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f4750314-200e-4346-a181-736d2b984b1e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 1.411164 Aug 26 08:55:12.639124 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 227/440] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:11 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:12.646425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f979461c-712f-4858-9cae-0e171933409a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:12.648249 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f979461c-712f-4858-9cae-0e171933409a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:12.662144 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f979461c-712f-4858-9cae-0e171933409a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:12.662811 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f979461c-712f-4858-9cae-0e171933409a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:12.663590 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f979461c-712f-4858-9cae-0e171933409a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:12.664596 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f979461c-712f-4858-9cae-0e171933409a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:12.665173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f979461c-712f-4858-9cae-0e171933409a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:12.667572 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-d9fe4430-c852-4584-91d6-9a95e185f243 req-e93a76e0-09fc-4982-9eda-c9a7473ae6fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1704235c-9819-4980-9ee0-b46ecd91de2e", "tag": "a81dfa72-6e98-4baf-ad11-0355ffe802a1"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:12.667875 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f979461c-712f-4858-9cae-0e171933409a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:12.684333 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-d9fe4430-c852-4584-91d6-9a95e185f243 req-e93a76e0-09fc-4982-9eda-c9a7473ae6fa service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:12.685101 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-d9fe4430-c852-4584-91d6-9a95e185f243 req-e93a76e0-09fc-4982-9eda-c9a7473ae6fa service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:12.685724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-d9fe4430-c852-4584-91d6-9a95e185f243 req-e93a76e0-09fc-4982-9eda-c9a7473ae6fa service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:12.716801 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f979461c-712f-4858-9cae-0e171933409a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/ips" status: 200 len: 150 microversion: 2.1 time: 0.077049 Aug 26 08:55:12.718961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 214/441] 10.222.0.71 () {58 vars in 1248 bytes} [Fri Aug 26 08:55:12 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/ips => generated 150 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:55:12.726273 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c105556a-f162-47fe-8716-a6b1c2c3b899 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:12.727436 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c105556a-f162-47fe-8716-a6b1c2c3b899 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:12.729585 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-d9fe4430-c852-4584-91d6-9a95e185f243 req-e93a76e0-09fc-4982-9eda-c9a7473ae6fa service nova] Creating event network-changed:a81dfa72-6e98-4baf-ad11-0355ffe802a1 for instance 1704235c-9819-4980-9ee0-b46ecd91de2e on hv-cinder-85236 Aug 26 08:55:12.736660 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c105556a-f162-47fe-8716-a6b1c2c3b899 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:12.738045 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c105556a-f162-47fe-8716-a6b1c2c3b899 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:12.739471 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c105556a-f162-47fe-8716-a6b1c2c3b899 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:12.740667 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c105556a-f162-47fe-8716-a6b1c2c3b899 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:12.741527 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c105556a-f162-47fe-8716-a6b1c2c3b899 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:12.742497 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c105556a-f162-47fe-8716-a6b1c2c3b899 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:12.744501 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-d9fe4430-c852-4584-91d6-9a95e185f243 req-e93a76e0-09fc-4982-9eda-c9a7473ae6fa service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087242 Aug 26 08:55:12.754614 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 228/442] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:55:13.039099 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c105556a-f162-47fe-8716-a6b1c2c3b899 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:13.068783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c105556a-f162-47fe-8716-a6b1c2c3b899 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.345029 Aug 26 08:55:13.070187 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 215/443] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:12 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:13.244376 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ab4ed285-b425-4020-8c90-58516ba4772c tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:13.248240 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ab4ed285-b425-4020-8c90-58516ba4772c tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:13.271128 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ab4ed285-b425-4020-8c90-58516ba4772c tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:13.272534 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ab4ed285-b425-4020-8c90-58516ba4772c tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:13.274147 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ab4ed285-b425-4020-8c90-58516ba4772c tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:13.275804 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ab4ed285-b425-4020-8c90-58516ba4772c tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:13.276781 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ab4ed285-b425-4020-8c90-58516ba4772c tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:13.277822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ab4ed285-b425-4020-8c90-58516ba4772c tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:13.654466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ab4ed285-b425-4020-8c90-58516ba4772c tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:13.680775 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-bc72bf72-7fc3-4392-9ef0-743f3c456f2b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:13.683405 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-bc72bf72-7fc3-4392-9ef0-743f3c456f2b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:13.696204 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc72bf72-7fc3-4392-9ef0-743f3c456f2b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:13.697065 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc72bf72-7fc3-4392-9ef0-743f3c456f2b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:13.698721 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc72bf72-7fc3-4392-9ef0-743f3c456f2b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:13.700266 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc72bf72-7fc3-4392-9ef0-743f3c456f2b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:13.700978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc72bf72-7fc3-4392-9ef0-743f3c456f2b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:13.702815 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bc72bf72-7fc3-4392-9ef0-743f3c456f2b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:13.711018 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ab4ed285-b425-4020-8c90-58516ba4772c tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.470054 Aug 26 08:55:13.712498 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 229/444] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:13 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:13.748418 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-fd3c74da-108d-4b8c-beca-fec7af378a5e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:13.756559 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-fd3c74da-108d-4b8c-beca-fec7af378a5e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:13.776207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd3c74da-108d-4b8c-beca-fec7af378a5e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:13.781040 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd3c74da-108d-4b8c-beca-fec7af378a5e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:13.782097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd3c74da-108d-4b8c-beca-fec7af378a5e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:13.784044 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd3c74da-108d-4b8c-beca-fec7af378a5e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:13.788210 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd3c74da-108d-4b8c-beca-fec7af378a5e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:13.789590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd3c74da-108d-4b8c-beca-fec7af378a5e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:14.266655 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bc72bf72-7fc3-4392-9ef0-743f3c456f2b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:14.285501 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bc72bf72-7fc3-4392-9ef0-743f3c456f2b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:14.289535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bc72bf72-7fc3-4392-9ef0-743f3c456f2b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:14.292718 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-bc72bf72-7fc3-4392-9ef0-743f3c456f2b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.626560 Aug 26 08:55:14.293921 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 216/445] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:13 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:14.294159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-fd3c74da-108d-4b8c-beca-fec7af378a5e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:14.297347 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:14.305217 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e351f02f-6407-480a-ba55-9cfb21928559 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:14.306847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e351f02f-6407-480a-ba55-9cfb21928559 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:14.316577 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-fd3c74da-108d-4b8c-beca-fec7af378a5e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 0.600258 Aug 26 08:55:14.338926 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 230/446] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:13 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:14.339274 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e351f02f-6407-480a-ba55-9cfb21928559 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:14.339274 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e351f02f-6407-480a-ba55-9cfb21928559 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:14.339274 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e351f02f-6407-480a-ba55-9cfb21928559 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:14.339274 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e351f02f-6407-480a-ba55-9cfb21928559 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:14.339815 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e351f02f-6407-480a-ba55-9cfb21928559 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:14.339815 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e351f02f-6407-480a-ba55-9cfb21928559 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:14.650626 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2a193c99-f870-4523-95eb-d9be9cebb952 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8165260-2d93-4a05-907f-a9bfded863b7"}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:14.655233 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2a193c99-f870-4523-95eb-d9be9cebb952 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:14.667637 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a193c99-f870-4523-95eb-d9be9cebb952 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:14.668815 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a193c99-f870-4523-95eb-d9be9cebb952 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:14.669887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a193c99-f870-4523-95eb-d9be9cebb952 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:14.671471 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a193c99-f870-4523-95eb-d9be9cebb952 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:14.672561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a193c99-f870-4523-95eb-d9be9cebb952 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:14.673607 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a193c99-f870-4523-95eb-d9be9cebb952 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:14.743353 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e351f02f-6407-480a-ba55-9cfb21928559 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:14.757171 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e351f02f-6407-480a-ba55-9cfb21928559 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.460834 Aug 26 08:55:14.777130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 217/447] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:14 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:14.792216 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d60725ee-c280-471c-8da6-3866d37e9358 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:14.793704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d60725ee-c280-471c-8da6-3866d37e9358 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:14.819456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d60725ee-c280-471c-8da6-3866d37e9358 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:14.821970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d60725ee-c280-471c-8da6-3866d37e9358 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:14.823600 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d60725ee-c280-471c-8da6-3866d37e9358 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:14.825260 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d60725ee-c280-471c-8da6-3866d37e9358 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:14.826867 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d60725ee-c280-471c-8da6-3866d37e9358 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:14.827927 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d60725ee-c280-471c-8da6-3866d37e9358 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:15.060185 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d60725ee-c280-471c-8da6-3866d37e9358 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:15.076466 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d60725ee-c280-471c-8da6-3866d37e9358 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.295449 Aug 26 08:55:15.077850 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 218/448] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:14 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:15.322875 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-96ec2350-dcfb-4ac5-b6c4-2eb324a51835 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:15.324309 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-96ec2350-dcfb-4ac5-b6c4-2eb324a51835 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:15.334172 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-96ec2350-dcfb-4ac5-b6c4-2eb324a51835 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:15.335431 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-96ec2350-dcfb-4ac5-b6c4-2eb324a51835 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:15.336403 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-96ec2350-dcfb-4ac5-b6c4-2eb324a51835 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:15.337561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-96ec2350-dcfb-4ac5-b6c4-2eb324a51835 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:15.338599 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-96ec2350-dcfb-4ac5-b6c4-2eb324a51835 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:15.339258 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-96ec2350-dcfb-4ac5-b6c4-2eb324a51835 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:15.581124 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-96ec2350-dcfb-4ac5-b6c4-2eb324a51835 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:15.597438 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-96ec2350-dcfb-4ac5-b6c4-2eb324a51835 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:15.600106 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-96ec2350-dcfb-4ac5-b6c4-2eb324a51835 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:15.601606 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-96ec2350-dcfb-4ac5-b6c4-2eb324a51835 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.284704 Aug 26 08:55:15.602542 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 219/449] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:15 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:55:15.609923 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-cf9b3266-5e44-4ebb-a3dd-74787864a5ed tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:15.611080 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-cf9b3266-5e44-4ebb-a3dd-74787864a5ed tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:15.619345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cf9b3266-5e44-4ebb-a3dd-74787864a5ed tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:15.620230 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cf9b3266-5e44-4ebb-a3dd-74787864a5ed tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:15.620879 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cf9b3266-5e44-4ebb-a3dd-74787864a5ed tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:15.621832 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cf9b3266-5e44-4ebb-a3dd-74787864a5ed tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:15.622295 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cf9b3266-5e44-4ebb-a3dd-74787864a5ed tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:15.622731 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cf9b3266-5e44-4ebb-a3dd-74787864a5ed tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:15.890976 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-cf9b3266-5e44-4ebb-a3dd-74787864a5ed tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:15.906136 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-cf9b3266-5e44-4ebb-a3dd-74787864a5ed tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 0.301286 Aug 26 08:55:15.923437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 220/450] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:15 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:15.937535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-57c00d3f-dc95-48d5-b35a-10dc5c7bbcc5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:15.939282 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-57c00d3f-dc95-48d5-b35a-10dc5c7bbcc5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:15.965898 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57c00d3f-dc95-48d5-b35a-10dc5c7bbcc5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:15.967762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57c00d3f-dc95-48d5-b35a-10dc5c7bbcc5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:15.971492 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57c00d3f-dc95-48d5-b35a-10dc5c7bbcc5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:15.973172 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57c00d3f-dc95-48d5-b35a-10dc5c7bbcc5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:15.974681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57c00d3f-dc95-48d5-b35a-10dc5c7bbcc5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:15.975755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57c00d3f-dc95-48d5-b35a-10dc5c7bbcc5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:16.316783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-57c00d3f-dc95-48d5-b35a-10dc5c7bbcc5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:16.332262 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-57c00d3f-dc95-48d5-b35a-10dc5c7bbcc5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.403793 Aug 26 08:55:16.332971 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 221/451] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:15 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:16.358104 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-65039dd5-8eb7-438a-a1f9-14290321f6fb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:16.360619 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-65039dd5-8eb7-438a-a1f9-14290321f6fb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:16.381168 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-65039dd5-8eb7-438a-a1f9-14290321f6fb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:16.382154 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-65039dd5-8eb7-438a-a1f9-14290321f6fb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:16.382929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-65039dd5-8eb7-438a-a1f9-14290321f6fb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:16.384728 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-65039dd5-8eb7-438a-a1f9-14290321f6fb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:16.385747 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-65039dd5-8eb7-438a-a1f9-14290321f6fb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:16.387106 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-65039dd5-8eb7-438a-a1f9-14290321f6fb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:17.027424 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-65039dd5-8eb7-438a-a1f9-14290321f6fb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:17.059500 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-65039dd5-8eb7-438a-a1f9-14290321f6fb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.724557 Aug 26 08:55:17.064642 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 222/452] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:16 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:17.075198 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2a193c99-f870-4523-95eb-d9be9cebb952 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "POST /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.434838 Aug 26 08:55:17.082028 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 231/453] 10.222.0.71 () {60 vars in 1323 bytes} [Fri Aug 26 08:55:14 2022] POST /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-volume_attachments => generated 194 bytes in 2443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:55:17.090927 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-628c2181-5e2a-4dfb-bdf9-574137d8b9f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:17.094284 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-628c2181-5e2a-4dfb-bdf9-574137d8b9f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:17.104367 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9d9fa9a7-5117-44b0-9350-7aa625b88c18 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:17.109576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9d9fa9a7-5117-44b0-9350-7aa625b88c18 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:17.121248 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-628c2181-5e2a-4dfb-bdf9-574137d8b9f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:17.125347 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-628c2181-5e2a-4dfb-bdf9-574137d8b9f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:17.126592 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-628c2181-5e2a-4dfb-bdf9-574137d8b9f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:17.130870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-628c2181-5e2a-4dfb-bdf9-574137d8b9f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:17.133144 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-628c2181-5e2a-4dfb-bdf9-574137d8b9f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:17.135700 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-628c2181-5e2a-4dfb-bdf9-574137d8b9f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:17.138471 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d9fa9a7-5117-44b0-9350-7aa625b88c18 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:17.139486 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d9fa9a7-5117-44b0-9350-7aa625b88c18 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:17.144309 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d9fa9a7-5117-44b0-9350-7aa625b88c18 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:17.146050 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d9fa9a7-5117-44b0-9350-7aa625b88c18 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:17.147093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d9fa9a7-5117-44b0-9350-7aa625b88c18 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:17.150790 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d9fa9a7-5117-44b0-9350-7aa625b88c18 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:17.508949 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-628c2181-5e2a-4dfb-bdf9-574137d8b9f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:17.523314 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-628c2181-5e2a-4dfb-bdf9-574137d8b9f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:17.526269 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-628c2181-5e2a-4dfb-bdf9-574137d8b9f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:17.528615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-628c2181-5e2a-4dfb-bdf9-574137d8b9f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.458280 Aug 26 08:55:17.543018 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 223/454] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:17 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:17.543018 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-51dc0e0f-a65d-403e-9500-f6b9ac14f969 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:17.543018 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-51dc0e0f-a65d-403e-9500-f6b9ac14f969 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:17.553127 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-51dc0e0f-a65d-403e-9500-f6b9ac14f969 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:17.555032 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-51dc0e0f-a65d-403e-9500-f6b9ac14f969 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:17.556213 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-51dc0e0f-a65d-403e-9500-f6b9ac14f969 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:17.565861 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-51dc0e0f-a65d-403e-9500-f6b9ac14f969 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:17.567131 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-51dc0e0f-a65d-403e-9500-f6b9ac14f969 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:17.568000 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-51dc0e0f-a65d-403e-9500-f6b9ac14f969 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:17.576865 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9d9fa9a7-5117-44b0-9350-7aa625b88c18 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:17.593352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9d9fa9a7-5117-44b0-9350-7aa625b88c18 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1261 microversion: 2.1 time: 0.505740 Aug 26 08:55:17.595022 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 232/455] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:17 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1261 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:17.827549 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-51dc0e0f-a65d-403e-9500-f6b9ac14f969 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:17.848703 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-51dc0e0f-a65d-403e-9500-f6b9ac14f969 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.316884 Aug 26 08:55:17.863283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 224/456] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:17 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:18.109467 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-615bf90b-5340-4d44-a29f-00c35c3289a1 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:18.115174 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-615bf90b-5340-4d44-a29f-00c35c3289a1 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:18.132551 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:18.135740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-615bf90b-5340-4d44-a29f-00c35c3289a1 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:18.137627 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-615bf90b-5340-4d44-a29f-00c35c3289a1 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:18.138728 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-615bf90b-5340-4d44-a29f-00c35c3289a1 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:18.141311 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-615bf90b-5340-4d44-a29f-00c35c3289a1 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:18.142491 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-615bf90b-5340-4d44-a29f-00c35c3289a1 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:18.143622 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-615bf90b-5340-4d44-a29f-00c35c3289a1 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:18.592269 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-821d4287-e72c-43e2-9806-f5f936f0d2af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:18.592269 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-821d4287-e72c-43e2-9806-f5f936f0d2af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:18.624441 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-821d4287-e72c-43e2-9806-f5f936f0d2af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:18.625201 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-821d4287-e72c-43e2-9806-f5f936f0d2af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:18.625870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-821d4287-e72c-43e2-9806-f5f936f0d2af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:18.627002 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-821d4287-e72c-43e2-9806-f5f936f0d2af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:18.627944 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-821d4287-e72c-43e2-9806-f5f936f0d2af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:18.628673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-821d4287-e72c-43e2-9806-f5f936f0d2af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:19.615475 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-615bf90b-5340-4d44-a29f-00c35c3289a1 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:19.643509 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-615bf90b-5340-4d44-a29f-00c35c3289a1 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 1.543652 Aug 26 08:55:19.654731 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 233/457] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:18 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:19.667900 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8dd1d15d-a415-4e26-90d4-e5879bf30ed2 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:19.669540 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8dd1d15d-a415-4e26-90d4-e5879bf30ed2 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:19.706565 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8dd1d15d-a415-4e26-90d4-e5879bf30ed2 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:19.710881 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8dd1d15d-a415-4e26-90d4-e5879bf30ed2 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:19.713768 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8dd1d15d-a415-4e26-90d4-e5879bf30ed2 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:19.718123 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8dd1d15d-a415-4e26-90d4-e5879bf30ed2 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:19.721771 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8dd1d15d-a415-4e26-90d4-e5879bf30ed2 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:19.722935 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8dd1d15d-a415-4e26-90d4-e5879bf30ed2 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:19.917794 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-821d4287-e72c-43e2-9806-f5f936f0d2af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:19.943455 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-821d4287-e72c-43e2-9806-f5f936f0d2af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:19.950425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-821d4287-e72c-43e2-9806-f5f936f0d2af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:19.953014 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-821d4287-e72c-43e2-9806-f5f936f0d2af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 1.372997 Aug 26 08:55:19.959546 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 225/458] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:18 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:19.974196 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3ec145a9-f5a6-4411-b706-71c3e849ddda tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:19.980342 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3ec145a9-f5a6-4411-b706-71c3e849ddda tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:20.002803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ec145a9-f5a6-4411-b706-71c3e849ddda tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:20.004392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ec145a9-f5a6-4411-b706-71c3e849ddda tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:20.005478 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ec145a9-f5a6-4411-b706-71c3e849ddda tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:20.011398 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ec145a9-f5a6-4411-b706-71c3e849ddda tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:20.012601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ec145a9-f5a6-4411-b706-71c3e849ddda tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:20.013661 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ec145a9-f5a6-4411-b706-71c3e849ddda tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:20.353901 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8dd1d15d-a415-4e26-90d4-e5879bf30ed2 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:20.393496 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8dd1d15d-a415-4e26-90d4-e5879bf30ed2 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1446 microversion: 2.1 time: 0.736547 Aug 26 08:55:20.404514 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 234/459] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:19 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1446 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:20.425224 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-02b56cee-90ff-4419-8cb0-c6eebae84447 req-712c4680-835d-4954-af9b-2338c28088f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba6e623-d5a4-4f7f-ab8f-ede13517de39", "name": "network-vif-plugged", "status": "completed", "tag": "390693e3-15ad-42f2-a309-c1c33a1f05d7"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:20.493646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-02b56cee-90ff-4419-8cb0-c6eebae84447 req-712c4680-835d-4954-af9b-2338c28088f3 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:20.495082 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-02b56cee-90ff-4419-8cb0-c6eebae84447 req-712c4680-835d-4954-af9b-2338c28088f3 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:20.495922 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-02b56cee-90ff-4419-8cb0-c6eebae84447 req-712c4680-835d-4954-af9b-2338c28088f3 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:20.516797 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3ec145a9-f5a6-4411-b706-71c3e849ddda tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:20.527645 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-02b56cee-90ff-4419-8cb0-c6eebae84447 req-712c4680-835d-4954-af9b-2338c28088f3 service nova] Creating event network-vif-plugged:390693e3-15ad-42f2-a309-c1c33a1f05d7 for instance 5ba6e623-d5a4-4f7f-ab8f-ede13517de39 on hv-cinder-85236 Aug 26 08:55:20.539127 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-02b56cee-90ff-4419-8cb0-c6eebae84447 req-712c4680-835d-4954-af9b-2338c28088f3 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125317 Aug 26 08:55:20.541047 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 235/460] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:55:20.544467 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-3ec145a9-f5a6-4411-b706-71c3e849ddda tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.582478 Aug 26 08:55:20.545767 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 226/461] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:19 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:20.589349 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1c8dccf4-3478-43f7-b5b4-8455d489ddef tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:20.592644 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1c8dccf4-3478-43f7-b5b4-8455d489ddef tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:20.620621 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1c8dccf4-3478-43f7-b5b4-8455d489ddef tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:20.627683 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1c8dccf4-3478-43f7-b5b4-8455d489ddef tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:20.629019 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1c8dccf4-3478-43f7-b5b4-8455d489ddef tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:20.630560 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1c8dccf4-3478-43f7-b5b4-8455d489ddef tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:20.631596 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1c8dccf4-3478-43f7-b5b4-8455d489ddef tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:20.632541 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1c8dccf4-3478-43f7-b5b4-8455d489ddef tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:20.698699 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-641dd93d-982f-4f03-bd32-8dedb42e8241 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:20.701434 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-641dd93d-982f-4f03-bd32-8dedb42e8241 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:20.720496 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-641dd93d-982f-4f03-bd32-8dedb42e8241 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:20.722532 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-641dd93d-982f-4f03-bd32-8dedb42e8241 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:20.723753 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-641dd93d-982f-4f03-bd32-8dedb42e8241 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:20.725378 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-641dd93d-982f-4f03-bd32-8dedb42e8241 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:20.726502 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-641dd93d-982f-4f03-bd32-8dedb42e8241 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:20.727654 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-641dd93d-982f-4f03-bd32-8dedb42e8241 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:21.034356 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-641dd93d-982f-4f03-bd32-8dedb42e8241 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:21.060368 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-641dd93d-982f-4f03-bd32-8dedb42e8241 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.372598 Aug 26 08:55:21.062043 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 227/462] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:20 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:21.076905 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-faefe6aa-e56f-4347-91a4-233f837ed63e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:21.078623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-faefe6aa-e56f-4347-91a4-233f837ed63e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:21.091862 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-faefe6aa-e56f-4347-91a4-233f837ed63e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:21.093295 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-faefe6aa-e56f-4347-91a4-233f837ed63e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:21.094496 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-faefe6aa-e56f-4347-91a4-233f837ed63e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:21.096474 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-faefe6aa-e56f-4347-91a4-233f837ed63e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:21.097687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-faefe6aa-e56f-4347-91a4-233f837ed63e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:21.098780 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-faefe6aa-e56f-4347-91a4-233f837ed63e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:21.303318 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1c8dccf4-3478-43f7-b5b4-8455d489ddef tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:21.321167 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1c8dccf4-3478-43f7-b5b4-8455d489ddef tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1446 microversion: 2.1 time: 0.776195 Aug 26 08:55:21.323883 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 236/463] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:20 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1446 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:21.581850 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3815350e-cd4e-431e-b544-daeba349ea02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:21.582317 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3815350e-cd4e-431e-b544-daeba349ea02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:21.599333 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3815350e-cd4e-431e-b544-daeba349ea02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:21.611957 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3815350e-cd4e-431e-b544-daeba349ea02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:21.613105 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3815350e-cd4e-431e-b544-daeba349ea02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:21.614623 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3815350e-cd4e-431e-b544-daeba349ea02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:21.615748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3815350e-cd4e-431e-b544-daeba349ea02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:21.616718 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3815350e-cd4e-431e-b544-daeba349ea02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:21.874801 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-faefe6aa-e56f-4347-91a4-233f837ed63e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:21.918393 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-faefe6aa-e56f-4347-91a4-233f837ed63e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:21.928405 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-faefe6aa-e56f-4347-91a4-233f837ed63e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:21.930672 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-faefe6aa-e56f-4347-91a4-233f837ed63e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.866300 Aug 26 08:55:21.931732 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 228/464] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:21 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:22.101557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-eca8054f-d596-4d33-a9a1-c0581a6ad343 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:22.102742 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-eca8054f-d596-4d33-a9a1-c0581a6ad343 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:22.133760 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eca8054f-d596-4d33-a9a1-c0581a6ad343 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:22.134562 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eca8054f-d596-4d33-a9a1-c0581a6ad343 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:22.135300 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eca8054f-d596-4d33-a9a1-c0581a6ad343 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:22.146520 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eca8054f-d596-4d33-a9a1-c0581a6ad343 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:22.147659 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eca8054f-d596-4d33-a9a1-c0581a6ad343 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:22.148408 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eca8054f-d596-4d33-a9a1-c0581a6ad343 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:22.290472 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3815350e-cd4e-431e-b544-daeba349ea02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:22.354542 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3815350e-cd4e-431e-b544-daeba349ea02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.776695 Aug 26 08:55:22.381374 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 237/465] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:21 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:22.722491 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-eca8054f-d596-4d33-a9a1-c0581a6ad343 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:22.751187 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-eca8054f-d596-4d33-a9a1-c0581a6ad343 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.655210 Aug 26 08:55:22.756184 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 229/466] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:22 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:22.979988 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4ef9eb6a-ea9a-4c2b-af56-c88aa835e8d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:22.986009 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4ef9eb6a-ea9a-4c2b-af56-c88aa835e8d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:23.022304 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ef9eb6a-ea9a-4c2b-af56-c88aa835e8d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:23.025269 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ef9eb6a-ea9a-4c2b-af56-c88aa835e8d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:23.027706 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ef9eb6a-ea9a-4c2b-af56-c88aa835e8d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:23.032325 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ef9eb6a-ea9a-4c2b-af56-c88aa835e8d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:23.035391 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ef9eb6a-ea9a-4c2b-af56-c88aa835e8d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:23.038598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ef9eb6a-ea9a-4c2b-af56-c88aa835e8d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:23.402871 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6d61b813-dd13-43c1-ae88-3bf95ced207f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:23.404050 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6d61b813-dd13-43c1-ae88-3bf95ced207f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:23.421013 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:23.445897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d61b813-dd13-43c1-ae88-3bf95ced207f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:23.446754 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d61b813-dd13-43c1-ae88-3bf95ced207f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:23.447510 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d61b813-dd13-43c1-ae88-3bf95ced207f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:23.467283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d61b813-dd13-43c1-ae88-3bf95ced207f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:23.468271 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d61b813-dd13-43c1-ae88-3bf95ced207f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:23.468992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d61b813-dd13-43c1-ae88-3bf95ced207f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:23.782826 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4ef9eb6a-ea9a-4c2b-af56-c88aa835e8d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:23.818637 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4ef9eb6a-ea9a-4c2b-af56-c88aa835e8d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:23.827725 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4ef9eb6a-ea9a-4c2b-af56-c88aa835e8d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:23.836734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4ef9eb6a-ea9a-4c2b-af56-c88aa835e8d1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.860976 Aug 26 08:55:23.839006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 238/467] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:22 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:55:23.860778 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-beb2465b-e743-4f33-8774-04aa924e1212 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:23.862455 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-beb2465b-e743-4f33-8774-04aa924e1212 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:23.882959 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-beb2465b-e743-4f33-8774-04aa924e1212 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:23.888175 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-beb2465b-e743-4f33-8774-04aa924e1212 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:23.895510 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-beb2465b-e743-4f33-8774-04aa924e1212 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:23.898063 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-beb2465b-e743-4f33-8774-04aa924e1212 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:23.900742 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-beb2465b-e743-4f33-8774-04aa924e1212 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:23.904161 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-beb2465b-e743-4f33-8774-04aa924e1212 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:24.239138 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6d61b813-dd13-43c1-ae88-3bf95ced207f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:24.256682 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=100 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:24.262217 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6d61b813-dd13-43c1-ae88-3bf95ced207f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.867726 Aug 26 08:55:24.267304 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 230/468] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:23 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:24.894483 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f9dc5424-84ff-4e0b-9002-3089103d39aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:24.896516 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f9dc5424-84ff-4e0b-9002-3089103d39aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:24.914763 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f9dc5424-84ff-4e0b-9002-3089103d39aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:24.919155 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f9dc5424-84ff-4e0b-9002-3089103d39aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:24.920017 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f9dc5424-84ff-4e0b-9002-3089103d39aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:24.921274 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f9dc5424-84ff-4e0b-9002-3089103d39aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:24.922104 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f9dc5424-84ff-4e0b-9002-3089103d39aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:24.925995 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f9dc5424-84ff-4e0b-9002-3089103d39aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:25.419473 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f9dc5424-84ff-4e0b-9002-3089103d39aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:25.446103 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f9dc5424-84ff-4e0b-9002-3089103d39aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:25.448942 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f9dc5424-84ff-4e0b-9002-3089103d39aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:25.464517 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f9dc5424-84ff-4e0b-9002-3089103d39aa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.576648 Aug 26 08:55:25.466687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 231/469] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:24 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:25.485967 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-61e1151c-2114-41ca-9b31-39ff437976ef tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:25.493633 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-61e1151c-2114-41ca-9b31-39ff437976ef tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:25.525391 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-61e1151c-2114-41ca-9b31-39ff437976ef tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:25.526603 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-61e1151c-2114-41ca-9b31-39ff437976ef tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:25.527357 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-61e1151c-2114-41ca-9b31-39ff437976ef tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:25.528586 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-61e1151c-2114-41ca-9b31-39ff437976ef tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:25.535761 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-61e1151c-2114-41ca-9b31-39ff437976ef tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:25.538993 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-61e1151c-2114-41ca-9b31-39ff437976ef tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:25.628189 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-beb2465b-e743-4f33-8774-04aa924e1212 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:25.665404 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-beb2465b-e743-4f33-8774-04aa924e1212 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 1.823979 Aug 26 08:55:25.684100 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 239/470] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:23 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:25.798723 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-c029bc78-9e70-4df5-969c-95a458cc4f20 req-bbef988a-530c-44b7-ab9e-4a97cffd9a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1704235c-9819-4980-9ee0-b46ecd91de2e", "name": "network-vif-plugged", "status": "completed", "tag": "a81dfa72-6e98-4baf-ad11-0355ffe802a1"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:25.847869 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-c029bc78-9e70-4df5-969c-95a458cc4f20 req-bbef988a-530c-44b7-ab9e-4a97cffd9a1f service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:25.849485 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-c029bc78-9e70-4df5-969c-95a458cc4f20 req-bbef988a-530c-44b7-ab9e-4a97cffd9a1f service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:25.856072 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-c029bc78-9e70-4df5-969c-95a458cc4f20 req-bbef988a-530c-44b7-ab9e-4a97cffd9a1f service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:25.934414 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-c029bc78-9e70-4df5-969c-95a458cc4f20 req-bbef988a-530c-44b7-ab9e-4a97cffd9a1f service nova] Creating event network-vif-plugged:a81dfa72-6e98-4baf-ad11-0355ffe802a1 for instance 1704235c-9819-4980-9ee0-b46ecd91de2e on hv-cinder-85236 Aug 26 08:55:25.952074 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-c029bc78-9e70-4df5-969c-95a458cc4f20 req-bbef988a-530c-44b7-ab9e-4a97cffd9a1f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161729 Aug 26 08:55:25.959073 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 240/471] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:55:26.382314 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-61e1151c-2114-41ca-9b31-39ff437976ef tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:26.426627 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-61e1151c-2114-41ca-9b31-39ff437976ef tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.947944 Aug 26 08:55:26.432829 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 232/472] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:25 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:26.517733 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0c2761ad-d4db-4cdf-956b-749eb0a33d8e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:26.529137 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0c2761ad-d4db-4cdf-956b-749eb0a33d8e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:26.587306 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0c2761ad-d4db-4cdf-956b-749eb0a33d8e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:26.590181 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0c2761ad-d4db-4cdf-956b-749eb0a33d8e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:26.590636 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0c2761ad-d4db-4cdf-956b-749eb0a33d8e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:26.610716 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0c2761ad-d4db-4cdf-956b-749eb0a33d8e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:26.611726 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0c2761ad-d4db-4cdf-956b-749eb0a33d8e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:26.627174 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0c2761ad-d4db-4cdf-956b-749eb0a33d8e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:26.712066 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0bda6480-9c7c-45ef-8348-193bd51fb1bb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:26.722917 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-0bda6480-9c7c-45ef-8348-193bd51fb1bb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:26.791522 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0bda6480-9c7c-45ef-8348-193bd51fb1bb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:26.793145 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0bda6480-9c7c-45ef-8348-193bd51fb1bb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:26.794253 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0bda6480-9c7c-45ef-8348-193bd51fb1bb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:26.795924 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0bda6480-9c7c-45ef-8348-193bd51fb1bb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:26.799957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0bda6480-9c7c-45ef-8348-193bd51fb1bb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:26.801145 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0bda6480-9c7c-45ef-8348-193bd51fb1bb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:27.237759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0c2761ad-d4db-4cdf-956b-749eb0a33d8e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:27.278272 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0c2761ad-d4db-4cdf-956b-749eb0a33d8e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:27.294325 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0c2761ad-d4db-4cdf-956b-749eb0a33d8e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:27.297127 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0c2761ad-d4db-4cdf-956b-749eb0a33d8e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.794603 Aug 26 08:55:27.299021 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 241/473] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:26 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:27.473107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3f2ee3b5-a09c-44ee-a1f4-14e7660cebe3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:27.474340 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3f2ee3b5-a09c-44ee-a1f4-14e7660cebe3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:27.516843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3f2ee3b5-a09c-44ee-a1f4-14e7660cebe3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:27.521601 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3f2ee3b5-a09c-44ee-a1f4-14e7660cebe3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:27.525917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3f2ee3b5-a09c-44ee-a1f4-14e7660cebe3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:27.527497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3f2ee3b5-a09c-44ee-a1f4-14e7660cebe3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:27.530736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3f2ee3b5-a09c-44ee-a1f4-14e7660cebe3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:27.534335 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3f2ee3b5-a09c-44ee-a1f4-14e7660cebe3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:27.905970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0bda6480-9c7c-45ef-8348-193bd51fb1bb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:27.944361 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-0bda6480-9c7c-45ef-8348-193bd51fb1bb tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 1.244297 Aug 26 08:55:27.947691 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 233/474] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:26 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:28.068133 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3f2ee3b5-a09c-44ee-a1f4-14e7660cebe3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:28.104046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3f2ee3b5-a09c-44ee-a1f4-14e7660cebe3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.637760 Aug 26 08:55:28.109889 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 242/475] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:27 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:28.354276 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2c509116-724b-4ddc-ac33-d0a4b2076828 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:28.355427 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2c509116-724b-4ddc-ac33-d0a4b2076828 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:28.389983 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2c509116-724b-4ddc-ac33-d0a4b2076828 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:28.390194 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2c509116-724b-4ddc-ac33-d0a4b2076828 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:28.390816 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2c509116-724b-4ddc-ac33-d0a4b2076828 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:28.400257 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2c509116-724b-4ddc-ac33-d0a4b2076828 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:28.401331 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2c509116-724b-4ddc-ac33-d0a4b2076828 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:28.402197 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2c509116-724b-4ddc-ac33-d0a4b2076828 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:28.899357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-625a6bb7-716f-4a91-9c90-a5d3b0d68233 req-d6afa33c-614e-4b69-b537-4d05a19835a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b667cb3-d4d2-4c6f-857f-98953e388820", "tag": "3a68c7ab-a856-4f62-ace7-5a4ee528bca2"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:28.931868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-625a6bb7-716f-4a91-9c90-a5d3b0d68233 req-d6afa33c-614e-4b69-b537-4d05a19835a8 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:28.934985 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-625a6bb7-716f-4a91-9c90-a5d3b0d68233 req-d6afa33c-614e-4b69-b537-4d05a19835a8 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:28.936221 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-625a6bb7-716f-4a91-9c90-a5d3b0d68233 req-d6afa33c-614e-4b69-b537-4d05a19835a8 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:28.965805 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-625a6bb7-716f-4a91-9c90-a5d3b0d68233 req-d6afa33c-614e-4b69-b537-4d05a19835a8 service nova] Creating event network-changed:3a68c7ab-a856-4f62-ace7-5a4ee528bca2 for instance 2b667cb3-d4d2-4c6f-857f-98953e388820 on hv-cinder-85236 Aug 26 08:55:28.980947 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-625a6bb7-716f-4a91-9c90-a5d3b0d68233 req-d6afa33c-614e-4b69-b537-4d05a19835a8 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093749 Aug 26 08:55:28.984281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 243/476] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:55:28.998680 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-218216d0-768b-4799-ad40-57bf4951bba8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:29.000445 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-218216d0-768b-4799-ad40-57bf4951bba8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:29.000679 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2c509116-724b-4ddc-ac33-d0a4b2076828 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:29.014681 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-218216d0-768b-4799-ad40-57bf4951bba8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:29.016193 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-218216d0-768b-4799-ad40-57bf4951bba8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:29.017262 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-218216d0-768b-4799-ad40-57bf4951bba8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:29.019984 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-218216d0-768b-4799-ad40-57bf4951bba8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:29.021164 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-218216d0-768b-4799-ad40-57bf4951bba8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:29.022434 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-218216d0-768b-4799-ad40-57bf4951bba8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:29.035710 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2c509116-724b-4ddc-ac33-d0a4b2076828 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:29.037209 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2c509116-724b-4ddc-ac33-d0a4b2076828 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:29.043515 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2c509116-724b-4ddc-ac33-d0a4b2076828 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.695966 Aug 26 08:55:29.046495 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 234/477] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:28 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:29.145712 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2b40249e-a103-4bdc-b33c-32c11d7a5dab tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:29.146980 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2b40249e-a103-4bdc-b33c-32c11d7a5dab tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:29.181477 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b40249e-a103-4bdc-b33c-32c11d7a5dab tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:29.186028 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b40249e-a103-4bdc-b33c-32c11d7a5dab tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:29.188480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b40249e-a103-4bdc-b33c-32c11d7a5dab tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:29.193042 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b40249e-a103-4bdc-b33c-32c11d7a5dab tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:29.195736 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b40249e-a103-4bdc-b33c-32c11d7a5dab tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:29.201922 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2b40249e-a103-4bdc-b33c-32c11d7a5dab tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:29.615088 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-218216d0-768b-4799-ad40-57bf4951bba8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:29.638392 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-218216d0-768b-4799-ad40-57bf4951bba8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.646653 Aug 26 08:55:29.640271 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 244/478] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:28 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:29.919595 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2b40249e-a103-4bdc-b33c-32c11d7a5dab tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:29.975408 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2b40249e-a103-4bdc-b33c-32c11d7a5dab tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.837674 Aug 26 08:55:29.979735 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 235/479] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:29 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:30.090820 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9341a861-3538-4b12-a707-c81597792db5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:30.093261 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9341a861-3538-4b12-a707-c81597792db5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:30.108848 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9341a861-3538-4b12-a707-c81597792db5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:30.114091 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9341a861-3538-4b12-a707-c81597792db5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:30.115114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9341a861-3538-4b12-a707-c81597792db5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:30.117364 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9341a861-3538-4b12-a707-c81597792db5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:30.120148 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9341a861-3538-4b12-a707-c81597792db5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:30.124510 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9341a861-3538-4b12-a707-c81597792db5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:30.464599 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9341a861-3538-4b12-a707-c81597792db5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:30.486471 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9341a861-3538-4b12-a707-c81597792db5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:30.490319 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9341a861-3538-4b12-a707-c81597792db5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:30.492618 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9341a861-3538-4b12-a707-c81597792db5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.409473 Aug 26 08:55:30.494119 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 245/480] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:30 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:30.691824 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3ede9412-f36e-4c62-9f50-744f8babc71e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:30.693363 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3ede9412-f36e-4c62-9f50-744f8babc71e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:30.703290 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ede9412-f36e-4c62-9f50-744f8babc71e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:30.703794 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ede9412-f36e-4c62-9f50-744f8babc71e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:30.704230 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ede9412-f36e-4c62-9f50-744f8babc71e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:30.704961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ede9412-f36e-4c62-9f50-744f8babc71e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:30.705575 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ede9412-f36e-4c62-9f50-744f8babc71e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:30.706287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ede9412-f36e-4c62-9f50-744f8babc71e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:31.014505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-efaefb83-4ce0-407e-8a53-046713a79729 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:31.015892 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-efaefb83-4ce0-407e-8a53-046713a79729 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:31.046507 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-efaefb83-4ce0-407e-8a53-046713a79729 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:31.047178 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-efaefb83-4ce0-407e-8a53-046713a79729 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:31.047844 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-efaefb83-4ce0-407e-8a53-046713a79729 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:31.048772 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-efaefb83-4ce0-407e-8a53-046713a79729 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:31.050274 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-efaefb83-4ce0-407e-8a53-046713a79729 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:31.050274 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-efaefb83-4ce0-407e-8a53-046713a79729 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:31.510183 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-efaefb83-4ce0-407e-8a53-046713a79729 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:31.542084 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-efaefb83-4ce0-407e-8a53-046713a79729 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.535011 Aug 26 08:55:31.549893 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 246/481] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:31 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:31.568656 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f5f94976-f39d-49a9-ab87-99525e9f75c9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:31.569922 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f5f94976-f39d-49a9-ab87-99525e9f75c9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:31.580754 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5f94976-f39d-49a9-ab87-99525e9f75c9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:31.582357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5f94976-f39d-49a9-ab87-99525e9f75c9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:31.583455 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5f94976-f39d-49a9-ab87-99525e9f75c9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:31.584953 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5f94976-f39d-49a9-ab87-99525e9f75c9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:31.586669 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5f94976-f39d-49a9-ab87-99525e9f75c9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:31.587702 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5f94976-f39d-49a9-ab87-99525e9f75c9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:31.737465 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3ede9412-f36e-4c62-9f50-744f8babc71e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:31.758584 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-3ede9412-f36e-4c62-9f50-744f8babc71e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 1.072838 Aug 26 08:55:31.772906 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 236/482] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:30 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:32.013806 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f5f94976-f39d-49a9-ab87-99525e9f75c9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:32.042261 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f5f94976-f39d-49a9-ab87-99525e9f75c9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:32.045347 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f5f94976-f39d-49a9-ab87-99525e9f75c9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:32.057050 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f5f94976-f39d-49a9-ab87-99525e9f75c9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.504974 Aug 26 08:55:32.059787 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 247/483] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:31 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:32.573424 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d8ee2d46-57e4-4d2f-a487-d531e0fd58cb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:32.574547 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d8ee2d46-57e4-4d2f-a487-d531e0fd58cb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:32.584475 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d8ee2d46-57e4-4d2f-a487-d531e0fd58cb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:32.585109 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d8ee2d46-57e4-4d2f-a487-d531e0fd58cb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:32.585836 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d8ee2d46-57e4-4d2f-a487-d531e0fd58cb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:32.587118 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d8ee2d46-57e4-4d2f-a487-d531e0fd58cb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:32.587849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d8ee2d46-57e4-4d2f-a487-d531e0fd58cb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:32.588524 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d8ee2d46-57e4-4d2f-a487-d531e0fd58cb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:32.794737 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b3538473-ab6f-411f-848e-8d871dc4c149 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:32.798225 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b3538473-ab6f-411f-848e-8d871dc4c149 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:32.844855 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b3538473-ab6f-411f-848e-8d871dc4c149 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:32.851168 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b3538473-ab6f-411f-848e-8d871dc4c149 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:32.855242 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b3538473-ab6f-411f-848e-8d871dc4c149 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:32.856889 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b3538473-ab6f-411f-848e-8d871dc4c149 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:32.865765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b3538473-ab6f-411f-848e-8d871dc4c149 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:32.868074 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b3538473-ab6f-411f-848e-8d871dc4c149 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:32.892566 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:33.281836 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d8ee2d46-57e4-4d2f-a487-d531e0fd58cb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:33.333506 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d8ee2d46-57e4-4d2f-a487-d531e0fd58cb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.766115 Aug 26 08:55:33.334482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 237/484] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:32 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:33.390318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9703a038-5076-47aa-96c4-a834b9554e3d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:33.393788 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b3538473-ab6f-411f-848e-8d871dc4c149 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:33.406977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9703a038-5076-47aa-96c4-a834b9554e3d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:33.409602 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b3538473-ab6f-411f-848e-8d871dc4c149 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.631454 Aug 26 08:55:33.411609 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 248/485] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:32 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:33.422296 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9703a038-5076-47aa-96c4-a834b9554e3d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:33.423293 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9703a038-5076-47aa-96c4-a834b9554e3d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:33.424102 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9703a038-5076-47aa-96c4-a834b9554e3d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:33.425346 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9703a038-5076-47aa-96c4-a834b9554e3d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:33.426164 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9703a038-5076-47aa-96c4-a834b9554e3d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:33.427032 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9703a038-5076-47aa-96c4-a834b9554e3d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:34.264473 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9703a038-5076-47aa-96c4-a834b9554e3d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:34.284714 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9703a038-5076-47aa-96c4-a834b9554e3d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:34.286521 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9703a038-5076-47aa-96c4-a834b9554e3d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:34.288001 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9703a038-5076-47aa-96c4-a834b9554e3d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.908147 Aug 26 08:55:34.288607 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 238/486] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:33 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:34.394645 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-bb45ae82-5ca6-49d3-81cd-3f887edaada6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:34.396068 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-bb45ae82-5ca6-49d3-81cd-3f887edaada6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:34.403980 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb45ae82-5ca6-49d3-81cd-3f887edaada6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:34.405105 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb45ae82-5ca6-49d3-81cd-3f887edaada6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:34.405908 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb45ae82-5ca6-49d3-81cd-3f887edaada6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:34.406664 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb45ae82-5ca6-49d3-81cd-3f887edaada6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:34.407313 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb45ae82-5ca6-49d3-81cd-3f887edaada6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:34.407900 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb45ae82-5ca6-49d3-81cd-3f887edaada6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:34.437300 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9a00a97e-4ae1-4e83-aedb-607996ec1c06 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:34.438515 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9a00a97e-4ae1-4e83-aedb-607996ec1c06 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:34.452953 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a00a97e-4ae1-4e83-aedb-607996ec1c06 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:34.453960 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a00a97e-4ae1-4e83-aedb-607996ec1c06 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:34.454686 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a00a97e-4ae1-4e83-aedb-607996ec1c06 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:34.455751 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a00a97e-4ae1-4e83-aedb-607996ec1c06 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:34.456397 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a00a97e-4ae1-4e83-aedb-607996ec1c06 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:34.456976 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a00a97e-4ae1-4e83-aedb-607996ec1c06 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:34.729634 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-bb45ae82-5ca6-49d3-81cd-3f887edaada6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:34.754251 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-bb45ae82-5ca6-49d3-81cd-3f887edaada6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.368822 Aug 26 08:55:34.755282 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 249/487] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:34 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:34.943771 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9a00a97e-4ae1-4e83-aedb-607996ec1c06 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:34.955220 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9a00a97e-4ae1-4e83-aedb-607996ec1c06 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.521742 Aug 26 08:55:34.956191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 239/488] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:34 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:35.321002 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2a7ea345-5e47-4b39-bec4-1ac591548590 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:35.321814 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2a7ea345-5e47-4b39-bec4-1ac591548590 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:35.332110 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a7ea345-5e47-4b39-bec4-1ac591548590 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:35.332860 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a7ea345-5e47-4b39-bec4-1ac591548590 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:35.333605 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a7ea345-5e47-4b39-bec4-1ac591548590 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:35.334643 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a7ea345-5e47-4b39-bec4-1ac591548590 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:35.335388 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a7ea345-5e47-4b39-bec4-1ac591548590 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:35.335985 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a7ea345-5e47-4b39-bec4-1ac591548590 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:35.545523 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2a7ea345-5e47-4b39-bec4-1ac591548590 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:35.562643 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2a7ea345-5e47-4b39-bec4-1ac591548590 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:35.566406 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2a7ea345-5e47-4b39-bec4-1ac591548590 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:35.567744 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2a7ea345-5e47-4b39-bec4-1ac591548590 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.252513 Aug 26 08:55:35.586189 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 250/489] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:35 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:55:35.779206 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-cfddbe8d-199d-49e0-b1c3-61844d11bec9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:35.780173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-cfddbe8d-199d-49e0-b1c3-61844d11bec9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:35.790793 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cfddbe8d-199d-49e0-b1c3-61844d11bec9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:35.791597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cfddbe8d-199d-49e0-b1c3-61844d11bec9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:35.792195 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cfddbe8d-199d-49e0-b1c3-61844d11bec9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:35.793406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cfddbe8d-199d-49e0-b1c3-61844d11bec9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:35.794158 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cfddbe8d-199d-49e0-b1c3-61844d11bec9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:35.794852 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cfddbe8d-199d-49e0-b1c3-61844d11bec9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:35.982079 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6341dbbc-097a-489a-8612-4d13ad0dc702 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:35.985544 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6341dbbc-097a-489a-8612-4d13ad0dc702 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:35.998291 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6341dbbc-097a-489a-8612-4d13ad0dc702 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:36.001166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6341dbbc-097a-489a-8612-4d13ad0dc702 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:36.002912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6341dbbc-097a-489a-8612-4d13ad0dc702 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:36.004753 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6341dbbc-097a-489a-8612-4d13ad0dc702 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:36.006151 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6341dbbc-097a-489a-8612-4d13ad0dc702 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:36.008681 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6341dbbc-097a-489a-8612-4d13ad0dc702 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:36.038713 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-cfddbe8d-199d-49e0-b1c3-61844d11bec9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:36.062660 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-cfddbe8d-199d-49e0-b1c3-61844d11bec9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.287229 Aug 26 08:55:36.064914 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 240/490] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:35 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:36.233133 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6341dbbc-097a-489a-8612-4d13ad0dc702 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:36.248215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6341dbbc-097a-489a-8612-4d13ad0dc702 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.271906 Aug 26 08:55:36.250619 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 251/491] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:35 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:36.594739 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-98a12f88-d989-4c4f-9129-673f41fb34a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:36.595644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-98a12f88-d989-4c4f-9129-673f41fb34a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:36.608225 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-98a12f88-d989-4c4f-9129-673f41fb34a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:36.608890 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-98a12f88-d989-4c4f-9129-673f41fb34a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:36.613894 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-98a12f88-d989-4c4f-9129-673f41fb34a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:36.616410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-98a12f88-d989-4c4f-9129-673f41fb34a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:36.619969 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-98a12f88-d989-4c4f-9129-673f41fb34a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:36.620742 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-98a12f88-d989-4c4f-9129-673f41fb34a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:36.901530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-98a12f88-d989-4c4f-9129-673f41fb34a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:36.922592 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-98a12f88-d989-4c4f-9129-673f41fb34a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:36.924821 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-98a12f88-d989-4c4f-9129-673f41fb34a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:36.928912 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-98a12f88-d989-4c4f-9129-673f41fb34a6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.338745 Aug 26 08:55:36.929877 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 241/492] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:36 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:37.092535 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d583ca29-78ec-4638-b79f-ff983fcde9da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:37.094250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d583ca29-78ec-4638-b79f-ff983fcde9da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:37.106834 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d583ca29-78ec-4638-b79f-ff983fcde9da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:37.108297 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d583ca29-78ec-4638-b79f-ff983fcde9da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:37.109338 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d583ca29-78ec-4638-b79f-ff983fcde9da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:37.111232 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d583ca29-78ec-4638-b79f-ff983fcde9da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:37.112073 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d583ca29-78ec-4638-b79f-ff983fcde9da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:37.113433 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d583ca29-78ec-4638-b79f-ff983fcde9da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:37.285208 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-43ca47cc-f867-48c1-9e0f-8c828b652f8f tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:37.286098 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-43ca47cc-f867-48c1-9e0f-8c828b652f8f tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:37.302320 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43ca47cc-f867-48c1-9e0f-8c828b652f8f tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:37.303162 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43ca47cc-f867-48c1-9e0f-8c828b652f8f tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:37.303816 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43ca47cc-f867-48c1-9e0f-8c828b652f8f tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:37.304774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43ca47cc-f867-48c1-9e0f-8c828b652f8f tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:37.305547 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43ca47cc-f867-48c1-9e0f-8c828b652f8f tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:37.306164 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43ca47cc-f867-48c1-9e0f-8c828b652f8f tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:37.477218 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d583ca29-78ec-4638-b79f-ff983fcde9da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:37.522380 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d583ca29-78ec-4638-b79f-ff983fcde9da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.430394 Aug 26 08:55:37.544069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 252/493] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:37 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:37.750109 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-43ca47cc-f867-48c1-9e0f-8c828b652f8f tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:37.759920 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-43ca47cc-f867-48c1-9e0f-8c828b652f8f tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.491519 Aug 26 08:55:37.775627 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 242/494] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:37 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:37.967227 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-51d13ab0-3b7d-46fe-a677-b81c89def218 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:37.968619 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-51d13ab0-3b7d-46fe-a677-b81c89def218 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:37.981688 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-51d13ab0-3b7d-46fe-a677-b81c89def218 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:37.982574 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-51d13ab0-3b7d-46fe-a677-b81c89def218 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:37.995776 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-51d13ab0-3b7d-46fe-a677-b81c89def218 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:37.996960 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-51d13ab0-3b7d-46fe-a677-b81c89def218 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:37.997640 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-51d13ab0-3b7d-46fe-a677-b81c89def218 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:37.998613 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-51d13ab0-3b7d-46fe-a677-b81c89def218 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:38.551045 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-89ecd1de-328d-4637-b37a-f24e916c509c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:38.552358 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-89ecd1de-328d-4637-b37a-f24e916c509c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:38.561519 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-89ecd1de-328d-4637-b37a-f24e916c509c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:38.562204 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-89ecd1de-328d-4637-b37a-f24e916c509c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:38.562800 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-89ecd1de-328d-4637-b37a-f24e916c509c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:38.563696 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-89ecd1de-328d-4637-b37a-f24e916c509c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:38.565341 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-89ecd1de-328d-4637-b37a-f24e916c509c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:38.567911 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-89ecd1de-328d-4637-b37a-f24e916c509c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:38.888754 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-51d13ab0-3b7d-46fe-a677-b81c89def218 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:38.902385 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-51d13ab0-3b7d-46fe-a677-b81c89def218 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:38.904180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-51d13ab0-3b7d-46fe-a677-b81c89def218 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:38.907283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-51d13ab0-3b7d-46fe-a677-b81c89def218 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.945176 Aug 26 08:55:38.920420 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 253/495] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:37 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:38.932300 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e24f7de7-11b7-46fe-acd0-b9bbe4546ecc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:38.933215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e24f7de7-11b7-46fe-acd0-b9bbe4546ecc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:38.941536 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e24f7de7-11b7-46fe-acd0-b9bbe4546ecc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:38.942766 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e24f7de7-11b7-46fe-acd0-b9bbe4546ecc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:38.943418 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e24f7de7-11b7-46fe-acd0-b9bbe4546ecc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:38.944398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e24f7de7-11b7-46fe-acd0-b9bbe4546ecc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:38.945037 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e24f7de7-11b7-46fe-acd0-b9bbe4546ecc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:38.945604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e24f7de7-11b7-46fe-acd0-b9bbe4546ecc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:39.018852 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-89ecd1de-328d-4637-b37a-f24e916c509c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:39.029120 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-89ecd1de-328d-4637-b37a-f24e916c509c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.482459 Aug 26 08:55:39.029715 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 243/496] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:38 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:39.034692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-09f52dd6-633f-42f7-a6d5-f8c9d904c5a4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Action: 'create', calling method: .version_select at 0x7f136c1bd550>, body: {"keypair": {"name": "tempest-keypair-1769815694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeaAR8u6Vl/fqs584vu6RYDleu0KrBNs3g5wJw9faIqeFOn48D+go7KZFJ++ac2pcc+DdLr9UYyScdLHRtW1qmCHkJNrayt2x6PEahq9XYNY49sqqeHFY8y5JfIBxyUTQ=="}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:39.104432 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-09f52dd6-633f-42f7-a6d5-f8c9d904c5a4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'key_pairs'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:55:39.116737 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-09f52dd6-633f-42f7-a6d5-f8c9d904c5a4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for user 406be06d6adf40bbb48d9baf12022988 and project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'key_pairs'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:55:39.194216 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-09f52dd6-633f-42f7-a6d5-f8c9d904c5a4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162693 Aug 26 08:55:39.195682 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 244/497] 10.222.0.71 () {60 vars in 1159 bytes} [Fri Aug 26 08:55:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:55:39.229266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e24f7de7-11b7-46fe-acd0-b9bbe4546ecc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:39.245995 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e24f7de7-11b7-46fe-acd0-b9bbe4546ecc tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.324058 Aug 26 08:55:39.263264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 254/498] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:38 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:39.938345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-25a01c0e-b585-43fd-b148-ed24553b2908 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:39.939407 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-25a01c0e-b585-43fd-b148-ed24553b2908 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:39.961457 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25a01c0e-b585-43fd-b148-ed24553b2908 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:39.966613 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25a01c0e-b585-43fd-b148-ed24553b2908 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:39.971985 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25a01c0e-b585-43fd-b148-ed24553b2908 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:39.976545 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25a01c0e-b585-43fd-b148-ed24553b2908 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:39.977455 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25a01c0e-b585-43fd-b148-ed24553b2908 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:39.977997 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25a01c0e-b585-43fd-b148-ed24553b2908 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:40.072775 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-22ef0d3d-91d2-4d3e-8f36-86d1d4e4b3c5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:40.073600 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-22ef0d3d-91d2-4d3e-8f36-86d1d4e4b3c5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:40.103284 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-22ef0d3d-91d2-4d3e-8f36-86d1d4e4b3c5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:40.105955 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-22ef0d3d-91d2-4d3e-8f36-86d1d4e4b3c5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:40.107886 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-22ef0d3d-91d2-4d3e-8f36-86d1d4e4b3c5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:40.113461 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-22ef0d3d-91d2-4d3e-8f36-86d1d4e4b3c5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:40.115591 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-22ef0d3d-91d2-4d3e-8f36-86d1d4e4b3c5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:40.116835 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-22ef0d3d-91d2-4d3e-8f36-86d1d4e4b3c5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:40.351066 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-25a01c0e-b585-43fd-b148-ed24553b2908 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:40.389855 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-25a01c0e-b585-43fd-b148-ed24553b2908 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:40.398050 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-25a01c0e-b585-43fd-b148-ed24553b2908 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:40.407870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-25a01c0e-b585-43fd-b148-ed24553b2908 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.476032 Aug 26 08:55:40.408894 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 245/499] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:39 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:55:40.417410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e321a2be-269b-4abf-9945-d29f427df09e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:40.422829 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e321a2be-269b-4abf-9945-d29f427df09e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:40.445903 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-22ef0d3d-91d2-4d3e-8f36-86d1d4e4b3c5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:40.447327 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e321a2be-269b-4abf-9945-d29f427df09e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:40.448519 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e321a2be-269b-4abf-9945-d29f427df09e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:40.448519 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e321a2be-269b-4abf-9945-d29f427df09e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:40.448981 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e321a2be-269b-4abf-9945-d29f427df09e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:40.449470 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e321a2be-269b-4abf-9945-d29f427df09e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:40.449871 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e321a2be-269b-4abf-9945-d29f427df09e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:40.462780 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-22ef0d3d-91d2-4d3e-8f36-86d1d4e4b3c5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1370 microversion: 2.1 time: 0.398744 Aug 26 08:55:40.474988 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 255/500] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:40 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1370 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:40.768167 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e321a2be-269b-4abf-9945-d29f427df09e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:40.777033 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e321a2be-269b-4abf-9945-d29f427df09e tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.366486 Aug 26 08:55:40.782257 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 246/501] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:40 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:41.444231 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b77abda5-1944-41e6-8ce7-b88c606be664 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:41.445157 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b77abda5-1944-41e6-8ce7-b88c606be664 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:41.466163 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b77abda5-1944-41e6-8ce7-b88c606be664 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:41.467068 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b77abda5-1944-41e6-8ce7-b88c606be664 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:41.467760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b77abda5-1944-41e6-8ce7-b88c606be664 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:41.468800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b77abda5-1944-41e6-8ce7-b88c606be664 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:41.469266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b77abda5-1944-41e6-8ce7-b88c606be664 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:41.469887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b77abda5-1944-41e6-8ce7-b88c606be664 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:41.491677 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6bd5bfd7-17ee-493e-9ded-f8f4a7834f54 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:41.492656 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6bd5bfd7-17ee-493e-9ded-f8f4a7834f54 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:41.518739 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6bd5bfd7-17ee-493e-9ded-f8f4a7834f54 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:41.520692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6bd5bfd7-17ee-493e-9ded-f8f4a7834f54 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:41.521793 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6bd5bfd7-17ee-493e-9ded-f8f4a7834f54 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:41.529614 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6bd5bfd7-17ee-493e-9ded-f8f4a7834f54 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:41.530690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6bd5bfd7-17ee-493e-9ded-f8f4a7834f54 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:41.531522 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6bd5bfd7-17ee-493e-9ded-f8f4a7834f54 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:41.808631 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b77abda5-1944-41e6-8ce7-b88c606be664 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:41.819994 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b77abda5-1944-41e6-8ce7-b88c606be664 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:41.822610 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b77abda5-1944-41e6-8ce7-b88c606be664 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:41.824938 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b77abda5-1944-41e6-8ce7-b88c606be664 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.385991 Aug 26 08:55:41.826091 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 256/502] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:41 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:41.836044 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-77e0b95e-66af-4bcf-aafb-2424cc5cd581 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:41.837439 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-77e0b95e-66af-4bcf-aafb-2424cc5cd581 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:41.848755 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-77e0b95e-66af-4bcf-aafb-2424cc5cd581 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:41.849927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-77e0b95e-66af-4bcf-aafb-2424cc5cd581 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:41.850974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-77e0b95e-66af-4bcf-aafb-2424cc5cd581 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:41.852359 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-77e0b95e-66af-4bcf-aafb-2424cc5cd581 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:41.854462 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-77e0b95e-66af-4bcf-aafb-2424cc5cd581 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:41.855539 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-77e0b95e-66af-4bcf-aafb-2424cc5cd581 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:41.987049 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6bd5bfd7-17ee-493e-9ded-f8f4a7834f54 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:42.007579 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6bd5bfd7-17ee-493e-9ded-f8f4a7834f54 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1565 microversion: 2.1 time: 0.522151 Aug 26 08:55:42.032859 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 247/503] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:41 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1565 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:42.043187 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fea2bffa-3bf6-45d5-980e-f5668afb0476 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:42.044397 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-fea2bffa-3bf6-45d5-980e-f5668afb0476 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:42.056168 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fea2bffa-3bf6-45d5-980e-f5668afb0476 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:42.057166 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fea2bffa-3bf6-45d5-980e-f5668afb0476 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:42.057757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fea2bffa-3bf6-45d5-980e-f5668afb0476 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:42.059135 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fea2bffa-3bf6-45d5-980e-f5668afb0476 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:42.059543 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fea2bffa-3bf6-45d5-980e-f5668afb0476 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:42.060207 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fea2bffa-3bf6-45d5-980e-f5668afb0476 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:42.082083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=100 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:42.166436 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-77e0b95e-66af-4bcf-aafb-2424cc5cd581 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:42.189649 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-77e0b95e-66af-4bcf-aafb-2424cc5cd581 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1314 microversion: 2.1 time: 0.360890 Aug 26 08:55:42.193671 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 257/504] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:41 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:42.724769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fea2bffa-3bf6-45d5-980e-f5668afb0476 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.683917 Aug 26 08:55:42.727354 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 248/505] 10.222.0.71 () {58 vars in 1275 bytes} [Fri Aug 26 08:55:42 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-interface => generated 285 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:55:42.883960 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c685cf4b-b93b-4520-9e00-52f6e9312936 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:42.886591 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c685cf4b-b93b-4520-9e00-52f6e9312936 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:42.904265 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c685cf4b-b93b-4520-9e00-52f6e9312936 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:42.905587 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c685cf4b-b93b-4520-9e00-52f6e9312936 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:42.906688 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c685cf4b-b93b-4520-9e00-52f6e9312936 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:42.908331 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c685cf4b-b93b-4520-9e00-52f6e9312936 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:42.909636 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c685cf4b-b93b-4520-9e00-52f6e9312936 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:42.910625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c685cf4b-b93b-4520-9e00-52f6e9312936 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:42.988507 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-819954295", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e1c5bc8-bb18-4879-912d-f9e237efa42e"}], "security_groups": [{"name": "tempest-securitygroup--1046618838"}], "key_name": "tempest-keypair-1769815694", "user_data": "}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:43.182153 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c685cf4b-b93b-4520-9e00-52f6e9312936 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:43.194260 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c685cf4b-b93b-4520-9e00-52f6e9312936 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:43.195714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c685cf4b-b93b-4520-9e00-52f6e9312936 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:43.197199 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c685cf4b-b93b-4520-9e00-52f6e9312936 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.334910 Aug 26 08:55:43.198205 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 258/506] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:42 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:55:43.223280 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-04de36fb-e357-4e59-acac-0689b2e2da62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:43.223890 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-04de36fb-e357-4e59-acac-0689b2e2da62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:43.234219 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-04de36fb-e357-4e59-acac-0689b2e2da62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:43.235014 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-04de36fb-e357-4e59-acac-0689b2e2da62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:43.235624 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-04de36fb-e357-4e59-acac-0689b2e2da62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:43.236520 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-04de36fb-e357-4e59-acac-0689b2e2da62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:43.237178 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-04de36fb-e357-4e59-acac-0689b2e2da62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:43.237746 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-04de36fb-e357-4e59-acac-0689b2e2da62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:43.259956 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.network.neutron [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] validate_networks() for [('4e1c5bc8-bb18-4879-912d-f9e237efa42e', None, None, None, None, None)] {{(pid=132217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:55:43.481963 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-04de36fb-e357-4e59-acac-0689b2e2da62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:43.492505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-04de36fb-e357-4e59-acac-0689b2e2da62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1464 microversion: 2.1 time: 0.272957 Aug 26 08:55:43.493319 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 259/507] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:43 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1464 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:43.544801 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-41f73690-53ed-4d4a-a4db-618bf2efedb4 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:43.545303 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-41f73690-53ed-4d4a-a4db-618bf2efedb4 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:43.552322 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-41f73690-53ed-4d4a-a4db-618bf2efedb4 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:43.552811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-41f73690-53ed-4d4a-a4db-618bf2efedb4 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:43.553238 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-41f73690-53ed-4d4a-a4db-618bf2efedb4 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:43.553945 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-41f73690-53ed-4d4a-a4db-618bf2efedb4 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:43.554394 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-41f73690-53ed-4d4a-a4db-618bf2efedb4 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:43.554806 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-41f73690-53ed-4d4a-a4db-618bf2efedb4 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:43.585818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-41f73690-53ed-4d4a-a4db-618bf2efedb4 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 08:55:43.742634 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-41f73690-53ed-4d4a-a4db-618bf2efedb4 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "DELETE /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 204 len: 0 microversion: 2.1 time: 0.198204 Aug 26 08:55:43.743430 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 260/508] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 08:55:43 2022] DELETE /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 08:55:43.756515 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c16c1a1a-74a1-4fe4-9149-f83e013e5c6a tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:43.757475 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c16c1a1a-74a1-4fe4-9149-f83e013e5c6a tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:43.766047 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c16c1a1a-74a1-4fe4-9149-f83e013e5c6a tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:43.768847 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c16c1a1a-74a1-4fe4-9149-f83e013e5c6a tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:43.769666 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c16c1a1a-74a1-4fe4-9149-f83e013e5c6a tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:43.770877 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c16c1a1a-74a1-4fe4-9149-f83e013e5c6a tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:43.771692 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c16c1a1a-74a1-4fe4-9149-f83e013e5c6a tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:43.772360 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c16c1a1a-74a1-4fe4-9149-f83e013e5c6a tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:44.017459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c16c1a1a-74a1-4fe4-9149-f83e013e5c6a tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:44.031146 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c16c1a1a-74a1-4fe4-9149-f83e013e5c6a tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1470 microversion: 2.1 time: 0.279786 Aug 26 08:55:44.031146 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 261/509] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:43 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1470 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:44.232215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c31519fc-083d-4f9b-ba7d-90a151065fb9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:44.232894 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c31519fc-083d-4f9b-ba7d-90a151065fb9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:44.252022 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c31519fc-083d-4f9b-ba7d-90a151065fb9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:44.253141 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c31519fc-083d-4f9b-ba7d-90a151065fb9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:44.254020 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c31519fc-083d-4f9b-ba7d-90a151065fb9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:44.255435 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c31519fc-083d-4f9b-ba7d-90a151065fb9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:44.256385 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c31519fc-083d-4f9b-ba7d-90a151065fb9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:44.257247 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c31519fc-083d-4f9b-ba7d-90a151065fb9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:44.379277 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Flavor limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:55:44.380941 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Image limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:55:44.381762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Flavor pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:55:44.382450 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Image pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:55:44.383264 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:55:44.398576 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:44.399731 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:44.400402 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:44.401689 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:44.402375 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:44.403214 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:44.424251 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:55:44.431215 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for user 406be06d6adf40bbb48d9baf12022988 and project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:55:44.459084 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Going to run 1 instances... {{(pid=132217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:55:44.470020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:55:44.501445 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c31519fc-083d-4f9b-ba7d-90a151065fb9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:44.513451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c31519fc-083d-4f9b-ba7d-90a151065fb9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:44.515703 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c31519fc-083d-4f9b-ba7d-90a151065fb9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:44.517368 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c31519fc-083d-4f9b-ba7d-90a151065fb9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.291432 Aug 26 08:55:44.518319 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 262/510] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:44 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:55:44.562165 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6d05da59-0f47-4dfc-a166-54f3a327175e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.586459 Aug 26 08:55:44.562981 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 249/511] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:55:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 08:55:44.575717 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5b752b7b-0901-47a4-bb7e-801edcbc45c6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:44.576497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5b752b7b-0901-47a4-bb7e-801edcbc45c6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:44.720891 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5b752b7b-0901-47a4-bb7e-801edcbc45c6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:44.745324 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-dbc92fd3-909a-4158-9e9f-11333a8fbc27 req-26e13ecb-fd82-4e13-a373-a4a09af1b9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1704235c-9819-4980-9ee0-b46ecd91de2e", "tag": "a81dfa72-6e98-4baf-ad11-0355ffe802a1"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:44.753150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5b752b7b-0901-47a4-bb7e-801edcbc45c6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1241 microversion: 2.1 time: 0.177038 Aug 26 08:55:44.762961 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 263/512] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:44 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1241 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:44.765482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-dbc92fd3-909a-4158-9e9f-11333a8fbc27 req-26e13ecb-fd82-4e13-a373-a4a09af1b9e3 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:44.766380 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-dbc92fd3-909a-4158-9e9f-11333a8fbc27 req-26e13ecb-fd82-4e13-a373-a4a09af1b9e3 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:44.767104 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-dbc92fd3-909a-4158-9e9f-11333a8fbc27 req-26e13ecb-fd82-4e13-a373-a4a09af1b9e3 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:44.798332 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-dbc92fd3-909a-4158-9e9f-11333a8fbc27 req-26e13ecb-fd82-4e13-a373-a4a09af1b9e3 service nova] Creating event network-changed:a81dfa72-6e98-4baf-ad11-0355ffe802a1 for instance 1704235c-9819-4980-9ee0-b46ecd91de2e on hv-cinder-85236 Aug 26 08:55:44.811823 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-dbc92fd3-909a-4158-9e9f-11333a8fbc27 req-26e13ecb-fd82-4e13-a373-a4a09af1b9e3 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069600 Aug 26 08:55:44.813623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 250/513] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:55:45.062447 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b13133af-689f-409b-85ff-d73e9e08c5a2 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:45.063566 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b13133af-689f-409b-85ff-d73e9e08c5a2 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:45.120812 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b13133af-689f-409b-85ff-d73e9e08c5a2 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:45.120812 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b13133af-689f-409b-85ff-d73e9e08c5a2 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:45.120812 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b13133af-689f-409b-85ff-d73e9e08c5a2 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:45.120812 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b13133af-689f-409b-85ff-d73e9e08c5a2 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:45.121454 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b13133af-689f-409b-85ff-d73e9e08c5a2 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:45.121454 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b13133af-689f-409b-85ff-d73e9e08c5a2 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:45.159499 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:45.393828 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b13133af-689f-409b-85ff-d73e9e08c5a2 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:45.408689 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b13133af-689f-409b-85ff-d73e9e08c5a2 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1470 microversion: 2.1 time: 0.351756 Aug 26 08:55:45.412997 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 264/514] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:45 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1470 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:45.543850 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ad69b5ca-4c16-4e45-a7f9-a1682946f2a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:45.545313 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ad69b5ca-4c16-4e45-a7f9-a1682946f2a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:45.561220 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ad69b5ca-4c16-4e45-a7f9-a1682946f2a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:45.562202 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ad69b5ca-4c16-4e45-a7f9-a1682946f2a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:45.562872 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ad69b5ca-4c16-4e45-a7f9-a1682946f2a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:45.564358 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ad69b5ca-4c16-4e45-a7f9-a1682946f2a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:45.565412 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ad69b5ca-4c16-4e45-a7f9-a1682946f2a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:45.566395 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ad69b5ca-4c16-4e45-a7f9-a1682946f2a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:45.783920 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a3e0656a-0260-4806-bb87-2099ea63a9b4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:45.784551 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a3e0656a-0260-4806-bb87-2099ea63a9b4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:45.796989 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ad69b5ca-4c16-4e45-a7f9-a1682946f2a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:45.805682 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a3e0656a-0260-4806-bb87-2099ea63a9b4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:45.811820 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a3e0656a-0260-4806-bb87-2099ea63a9b4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:45.812696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a3e0656a-0260-4806-bb87-2099ea63a9b4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:45.814008 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ad69b5ca-4c16-4e45-a7f9-a1682946f2a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:45.815082 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a3e0656a-0260-4806-bb87-2099ea63a9b4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:45.815784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a3e0656a-0260-4806-bb87-2099ea63a9b4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:45.819081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a3e0656a-0260-4806-bb87-2099ea63a9b4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:45.820092 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ad69b5ca-4c16-4e45-a7f9-a1682946f2a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:45.826275 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ad69b5ca-4c16-4e45-a7f9-a1682946f2a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.287581 Aug 26 08:55:45.828295 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 251/515] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:45 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:45.909420 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a3e0656a-0260-4806-bb87-2099ea63a9b4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:45.925699 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a3e0656a-0260-4806-bb87-2099ea63a9b4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1245 microversion: 2.1 time: 0.146452 Aug 26 08:55:45.930943 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 265/516] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:45 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1245 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:46.438749 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-aa3b7f09-8492-463e-96ca-f32aed2f7259 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:46.439722 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-aa3b7f09-8492-463e-96ca-f32aed2f7259 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:46.453228 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aa3b7f09-8492-463e-96ca-f32aed2f7259 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:46.454141 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aa3b7f09-8492-463e-96ca-f32aed2f7259 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:46.454794 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aa3b7f09-8492-463e-96ca-f32aed2f7259 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:46.455762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aa3b7f09-8492-463e-96ca-f32aed2f7259 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:46.459576 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aa3b7f09-8492-463e-96ca-f32aed2f7259 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:46.461526 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aa3b7f09-8492-463e-96ca-f32aed2f7259 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:46.669779 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-aa3b7f09-8492-463e-96ca-f32aed2f7259 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:46.679724 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-aa3b7f09-8492-463e-96ca-f32aed2f7259 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1470 microversion: 2.1 time: 0.250100 Aug 26 08:55:46.680741 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 252/517] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:46 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1470 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:46.851298 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-417ffa66-7d04-471e-84ed-e65d7657fec7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:46.852849 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-417ffa66-7d04-471e-84ed-e65d7657fec7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:46.876715 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-417ffa66-7d04-471e-84ed-e65d7657fec7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:46.877775 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-417ffa66-7d04-471e-84ed-e65d7657fec7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:46.878397 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-417ffa66-7d04-471e-84ed-e65d7657fec7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:46.879478 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-417ffa66-7d04-471e-84ed-e65d7657fec7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:46.880107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-417ffa66-7d04-471e-84ed-e65d7657fec7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:46.880676 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-417ffa66-7d04-471e-84ed-e65d7657fec7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:46.951082 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b81fb9f5-db77-4445-a10e-8f709c7aeaec tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:46.952160 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b81fb9f5-db77-4445-a10e-8f709c7aeaec tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:46.965356 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b81fb9f5-db77-4445-a10e-8f709c7aeaec tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:46.969698 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b81fb9f5-db77-4445-a10e-8f709c7aeaec tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:46.970368 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b81fb9f5-db77-4445-a10e-8f709c7aeaec tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:46.971324 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b81fb9f5-db77-4445-a10e-8f709c7aeaec tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:46.971945 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b81fb9f5-db77-4445-a10e-8f709c7aeaec tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:46.972528 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b81fb9f5-db77-4445-a10e-8f709c7aeaec tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:47.166265 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b81fb9f5-db77-4445-a10e-8f709c7aeaec tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:47.182978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b81fb9f5-db77-4445-a10e-8f709c7aeaec tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1245 microversion: 2.1 time: 0.238029 Aug 26 08:55:47.184431 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 253/518] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:46 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1245 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:47.211595 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-417ffa66-7d04-471e-84ed-e65d7657fec7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:47.222802 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-417ffa66-7d04-471e-84ed-e65d7657fec7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:47.224398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-417ffa66-7d04-471e-84ed-e65d7657fec7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:47.225666 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-417ffa66-7d04-471e-84ed-e65d7657fec7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.378606 Aug 26 08:55:47.229257 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 266/519] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:46 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:55:47.711154 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6e532e11-faeb-4b8f-abd2-3e811d2bb4e8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:47.712395 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6e532e11-faeb-4b8f-abd2-3e811d2bb4e8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:47.723475 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e532e11-faeb-4b8f-abd2-3e811d2bb4e8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:47.724770 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e532e11-faeb-4b8f-abd2-3e811d2bb4e8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:47.725860 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e532e11-faeb-4b8f-abd2-3e811d2bb4e8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:47.727686 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e532e11-faeb-4b8f-abd2-3e811d2bb4e8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:47.728839 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e532e11-faeb-4b8f-abd2-3e811d2bb4e8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:47.729910 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e532e11-faeb-4b8f-abd2-3e811d2bb4e8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:48.095677 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6e532e11-faeb-4b8f-abd2-3e811d2bb4e8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:48.110614 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6e532e11-faeb-4b8f-abd2-3e811d2bb4e8 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1470 microversion: 2.1 time: 0.403451 Aug 26 08:55:48.111361 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 254/520] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:47 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1470 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:48.206068 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d82ef4a5-4660-48ba-828d-b97d590a9552 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:48.207446 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d82ef4a5-4660-48ba-828d-b97d590a9552 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:48.215398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d82ef4a5-4660-48ba-828d-b97d590a9552 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:48.216252 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d82ef4a5-4660-48ba-828d-b97d590a9552 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:48.217280 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d82ef4a5-4660-48ba-828d-b97d590a9552 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:48.218407 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d82ef4a5-4660-48ba-828d-b97d590a9552 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:48.219034 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d82ef4a5-4660-48ba-828d-b97d590a9552 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:48.219971 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d82ef4a5-4660-48ba-828d-b97d590a9552 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:48.257918 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8e715c95-9974-46ce-a124-d9525a6b3e31 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:48.258760 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8e715c95-9974-46ce-a124-d9525a6b3e31 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:48.269722 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8e715c95-9974-46ce-a124-d9525a6b3e31 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:48.294809 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8e715c95-9974-46ce-a124-d9525a6b3e31 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:48.296630 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8e715c95-9974-46ce-a124-d9525a6b3e31 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:48.299143 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8e715c95-9974-46ce-a124-d9525a6b3e31 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:48.307522 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8e715c95-9974-46ce-a124-d9525a6b3e31 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:48.308757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8e715c95-9974-46ce-a124-d9525a6b3e31 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:48.331547 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d82ef4a5-4660-48ba-828d-b97d590a9552 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:48.345014 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d82ef4a5-4660-48ba-828d-b97d590a9552 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1237 microversion: 2.1 time: 0.142913 Aug 26 08:55:48.349313 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 267/521] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:48 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1237 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:48.583412 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8e715c95-9974-46ce-a124-d9525a6b3e31 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:48.601807 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8e715c95-9974-46ce-a124-d9525a6b3e31 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:48.607523 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8e715c95-9974-46ce-a124-d9525a6b3e31 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:48.610697 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8e715c95-9974-46ce-a124-d9525a6b3e31 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.358365 Aug 26 08:55:48.627696 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 255/522] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:48 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:49.143911 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1edf9f15-907e-443a-ad6b-ee397dcfa96b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:49.144760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1edf9f15-907e-443a-ad6b-ee397dcfa96b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:49.152402 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:49.166496 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1edf9f15-907e-443a-ad6b-ee397dcfa96b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:49.168933 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1edf9f15-907e-443a-ad6b-ee397dcfa96b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:49.171440 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1edf9f15-907e-443a-ad6b-ee397dcfa96b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:49.172600 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1edf9f15-907e-443a-ad6b-ee397dcfa96b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:49.174195 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1edf9f15-907e-443a-ad6b-ee397dcfa96b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:49.175082 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1edf9f15-907e-443a-ad6b-ee397dcfa96b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:49.389710 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4d50e47f-a94a-4378-bb1d-dc0243f59254 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:49.397838 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4d50e47f-a94a-4378-bb1d-dc0243f59254 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:49.411794 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d50e47f-a94a-4378-bb1d-dc0243f59254 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:49.413076 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d50e47f-a94a-4378-bb1d-dc0243f59254 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:49.413981 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d50e47f-a94a-4378-bb1d-dc0243f59254 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:49.415813 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d50e47f-a94a-4378-bb1d-dc0243f59254 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:49.416876 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d50e47f-a94a-4378-bb1d-dc0243f59254 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:49.418455 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d50e47f-a94a-4378-bb1d-dc0243f59254 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:49.563664 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-4d50e47f-a94a-4378-bb1d-dc0243f59254 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:49.576071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4d50e47f-a94a-4378-bb1d-dc0243f59254 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1293 microversion: 2.1 time: 0.197439 Aug 26 08:55:49.577417 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 256/523] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:49 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1293 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:49.586357 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-64c407c4-ead2-453c-9d1c-3a656e97a919 req-08763813-0431-4f8b-9faf-3101806bb67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0d2d4-3218-426b-a548-91c5891780fa", "name": "network-vif-plugged", "status": "completed", "tag": "61d58bf1-2d6c-4df7-8638-a30df721d2e9"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:49.612162 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-64c407c4-ead2-453c-9d1c-3a656e97a919 req-08763813-0431-4f8b-9faf-3101806bb67b service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:49.617034 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-64c407c4-ead2-453c-9d1c-3a656e97a919 req-08763813-0431-4f8b-9faf-3101806bb67b service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:49.619753 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-64c407c4-ead2-453c-9d1c-3a656e97a919 req-08763813-0431-4f8b-9faf-3101806bb67b service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:49.659793 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-64c407c4-ead2-453c-9d1c-3a656e97a919 req-08763813-0431-4f8b-9faf-3101806bb67b service nova] Creating event network-vif-plugged:61d58bf1-2d6c-4df7-8638-a30df721d2e9 for instance 8de0d2d4-3218-426b-a548-91c5891780fa on hv-cinder-85236 Aug 26 08:55:49.673247 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-64c407c4-ead2-453c-9d1c-3a656e97a919 req-08763813-0431-4f8b-9faf-3101806bb67b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093072 Aug 26 08:55:49.674204 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 257/524] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:55:49.681973 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a37036d4-cc13-4c39-846d-41fafbf672a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:49.687376 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a37036d4-cc13-4c39-846d-41fafbf672a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:49.695209 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a37036d4-cc13-4c39-846d-41fafbf672a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:49.696286 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a37036d4-cc13-4c39-846d-41fafbf672a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:49.696913 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a37036d4-cc13-4c39-846d-41fafbf672a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:49.698612 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a37036d4-cc13-4c39-846d-41fafbf672a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:49.699544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a37036d4-cc13-4c39-846d-41fafbf672a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:49.700122 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a37036d4-cc13-4c39-846d-41fafbf672a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:49.751669 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1edf9f15-907e-443a-ad6b-ee397dcfa96b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:49.784878 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1edf9f15-907e-443a-ad6b-ee397dcfa96b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1470 microversion: 2.1 time: 0.649583 Aug 26 08:55:49.785812 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 268/525] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:49 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1470 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:49.820911 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-ad5b1219-932c-4580-b96b-cd0d1ae8bab5 req-4e05f4e1-9d87-4d39-8096-96fe2d32ed65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba6e623-d5a4-4f7f-ab8f-ede13517de39", "name": "network-vif-deleted", "tag": "390693e3-15ad-42f2-a309-c1c33a1f05d7"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:49.845167 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-ad5b1219-932c-4580-b96b-cd0d1ae8bab5 req-4e05f4e1-9d87-4d39-8096-96fe2d32ed65 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:49.845671 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-ad5b1219-932c-4580-b96b-cd0d1ae8bab5 req-4e05f4e1-9d87-4d39-8096-96fe2d32ed65 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:49.848155 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-ad5b1219-932c-4580-b96b-cd0d1ae8bab5 req-4e05f4e1-9d87-4d39-8096-96fe2d32ed65 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:49.877391 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-ad5b1219-932c-4580-b96b-cd0d1ae8bab5 req-4e05f4e1-9d87-4d39-8096-96fe2d32ed65 service nova] Creating event network-vif-deleted:390693e3-15ad-42f2-a309-c1c33a1f05d7 for instance 5ba6e623-d5a4-4f7f-ab8f-ede13517de39 on hv-cinder-85236 Aug 26 08:55:49.888095 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-ad5b1219-932c-4580-b96b-cd0d1ae8bab5 req-4e05f4e1-9d87-4d39-8096-96fe2d32ed65 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079669 Aug 26 08:55:49.889321 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 269/526] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:55:50.018880 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a37036d4-cc13-4c39-846d-41fafbf672a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:50.048487 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a37036d4-cc13-4c39-846d-41fafbf672a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:50.050620 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a37036d4-cc13-4c39-846d-41fafbf672a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:50.052466 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a37036d4-cc13-4c39-846d-41fafbf672a4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.376651 Aug 26 08:55:50.053587 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 258/527] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:49 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:50.151279 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-270c6a12-45dd-4d9a-8d04-fac762368b85 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Action: 'create', calling method: .version_select at 0x7f136c0cb940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1168771069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Upl/sRcofcGawWQxmBwgFLGri9XKAgfJi2rI8pEqIPfWQbFw5dbmAdb5tCep5c8FRGxe+bom4YvzE9ITNiFAMa3YkpfnL73w0eCWsYDfS3O6DuRtMvygmlyTA+Re+WQ=="}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:50.176128 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-270c6a12-45dd-4d9a-8d04-fac762368b85 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Getting quotas for project 3d18cb354a0f46faba6c00b89b4e4b1c. Resources: {'key_pairs'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:55:50.184036 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-270c6a12-45dd-4d9a-8d04-fac762368b85 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Getting quotas for user 2cee3394dbdd4cb3a52005ee357d3be7 and project 3d18cb354a0f46faba6c00b89b4e4b1c. Resources: {'key_pairs'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:55:50.220180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-270c6a12-45dd-4d9a-8d04-fac762368b85 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.076385 Aug 26 08:55:50.220811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 270/528] 10.222.0.71 () {60 vars in 1159 bytes} [Fri Aug 26 08:55:50 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:55:50.277925 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1263738705", "imageRef": "3e1723e7-f3a9-4212-9e2a-89fd069d2cf5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1168771069", "networks": [{"uuid": "ac639d8e-0bd5-49fe-b0cc-78725e66b385"}]}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:50.348794 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.network.neutron [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] validate_networks() for [('ac639d8e-0bd5-49fe-b0cc-78725e66b385', None, None, None, None, None)] {{(pid=132217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:55:50.617092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-568dfdb5-4943-437d-851a-33b759c3fdf4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:50.618167 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-568dfdb5-4943-437d-851a-33b759c3fdf4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:50.627336 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-568dfdb5-4943-437d-851a-33b759c3fdf4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:50.628104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-568dfdb5-4943-437d-851a-33b759c3fdf4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:50.628719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-568dfdb5-4943-437d-851a-33b759c3fdf4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:50.629602 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-568dfdb5-4943-437d-851a-33b759c3fdf4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:50.630202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-568dfdb5-4943-437d-851a-33b759c3fdf4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:50.630766 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-568dfdb5-4943-437d-851a-33b759c3fdf4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:50.710589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-568dfdb5-4943-437d-851a-33b759c3fdf4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:50.720790 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-568dfdb5-4943-437d-851a-33b759c3fdf4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1301 microversion: 2.1 time: 0.110565 Aug 26 08:55:50.721403 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 271/529] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:50 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1301 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:50.815505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ecd28804-1ef7-4438-aa9a-3216f22f3220 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:50.816240 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ecd28804-1ef7-4438-aa9a-3216f22f3220 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:50.826620 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecd28804-1ef7-4438-aa9a-3216f22f3220 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:50.827389 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecd28804-1ef7-4438-aa9a-3216f22f3220 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:50.828398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecd28804-1ef7-4438-aa9a-3216f22f3220 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:50.829282 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecd28804-1ef7-4438-aa9a-3216f22f3220 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:50.830011 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecd28804-1ef7-4438-aa9a-3216f22f3220 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:50.830531 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecd28804-1ef7-4438-aa9a-3216f22f3220 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:50.867055 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecd28804-1ef7-4438-aa9a-3216f22f3220 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:50.867525 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecd28804-1ef7-4438-aa9a-3216f22f3220 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:50.868018 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ecd28804-1ef7-4438-aa9a-3216f22f3220 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:50.868572 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-ecd28804-1ef7-4438-aa9a-3216f22f3220 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lazy-loading 'fault' on Instance uuid 5ba6e623-d5a4-4f7f-ab8f-ede13517de39 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:55:50.919010 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ecd28804-1ef7-4438-aa9a-3216f22f3220 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:50.927920 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ecd28804-1ef7-4438-aa9a-3216f22f3220 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1304 microversion: 2.1 time: 0.117704 Aug 26 08:55:50.928675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 272/530] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:50 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:51.092713 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ab1e9235-db70-42a8-abaa-b85066a6113f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:51.093827 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ab1e9235-db70-42a8-abaa-b85066a6113f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:51.100461 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ab1e9235-db70-42a8-abaa-b85066a6113f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:51.100968 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ab1e9235-db70-42a8-abaa-b85066a6113f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:51.101415 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ab1e9235-db70-42a8-abaa-b85066a6113f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:51.102149 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ab1e9235-db70-42a8-abaa-b85066a6113f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:51.102703 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ab1e9235-db70-42a8-abaa-b85066a6113f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:51.103192 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ab1e9235-db70-42a8-abaa-b85066a6113f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:51.160827 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Flavor limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:55:51.161603 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Image limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:55:51.162391 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Flavor pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:55:51.163239 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Image pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:55:51.163954 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:55:51.186161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:51.186605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:51.187277 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:51.188436 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:51.188878 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:51.189569 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:51.226347 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Getting quotas for project 3d18cb354a0f46faba6c00b89b4e4b1c. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:55:51.235020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Getting quotas for user 2cee3394dbdd4cb3a52005ee357d3be7 and project 3d18cb354a0f46faba6c00b89b4e4b1c. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:55:51.295909 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Going to run 1 instances... {{(pid=132217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:55:51.312813 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e1723e7-f3a9-4212-9e2a-89fd069d2cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:55:51.393039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:51.402995 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ab1e9235-db70-42a8-abaa-b85066a6113f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:51.415027 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ab1e9235-db70-42a8-abaa-b85066a6113f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:51.416862 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ab1e9235-db70-42a8-abaa-b85066a6113f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:51.418487 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ab1e9235-db70-42a8-abaa-b85066a6113f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.330314 Aug 26 08:55:51.419440 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 273/531] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:51 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:51.453676 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2fe9b1c2-105b-4a48-9ad7-ef08199fe1ea tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.177243 Aug 26 08:55:51.454842 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 259/532] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:55:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 08:55:51.483206 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1c5ad396-3cdc-4c65-b58c-1b87ecf6e7e1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:51.484568 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1c5ad396-3cdc-4c65-b58c-1b87ecf6e7e1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:51.651094 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1c5ad396-3cdc-4c65-b58c-1b87ecf6e7e1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:51.663628 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1c5ad396-3cdc-4c65-b58c-1b87ecf6e7e1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1259 microversion: 2.1 time: 0.197077 Aug 26 08:55:51.664868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 274/533] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:51 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:51.745766 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9868d130-3cc2-48e3-aa19-a8851802e9ad tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:51.746405 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9868d130-3cc2-48e3-aa19-a8851802e9ad tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:51.755979 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9868d130-3cc2-48e3-aa19-a8851802e9ad tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:51.756475 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9868d130-3cc2-48e3-aa19-a8851802e9ad tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:51.756950 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9868d130-3cc2-48e3-aa19-a8851802e9ad tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:51.757730 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9868d130-3cc2-48e3-aa19-a8851802e9ad tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:51.758191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9868d130-3cc2-48e3-aa19-a8851802e9ad tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:51.758822 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9868d130-3cc2-48e3-aa19-a8851802e9ad tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:51.844969 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9868d130-3cc2-48e3-aa19-a8851802e9ad tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:51.856180 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9868d130-3cc2-48e3-aa19-a8851802e9ad tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1299 microversion: 2.1 time: 0.115568 Aug 26 08:55:51.857119 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 260/534] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:51 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:51.952725 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-cfd55b29-faa5-4135-a77c-25f24a29984b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:51.953335 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-cfd55b29-faa5-4135-a77c-25f24a29984b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:51.962525 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cfd55b29-faa5-4135-a77c-25f24a29984b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:51.963202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cfd55b29-faa5-4135-a77c-25f24a29984b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:51.963717 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cfd55b29-faa5-4135-a77c-25f24a29984b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:51.964520 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cfd55b29-faa5-4135-a77c-25f24a29984b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:51.965146 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cfd55b29-faa5-4135-a77c-25f24a29984b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:51.965680 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cfd55b29-faa5-4135-a77c-25f24a29984b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:52.007630 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cfd55b29-faa5-4135-a77c-25f24a29984b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:52.008119 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cfd55b29-faa5-4135-a77c-25f24a29984b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:52.008635 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cfd55b29-faa5-4135-a77c-25f24a29984b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:52.009221 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-cfd55b29-faa5-4135-a77c-25f24a29984b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lazy-loading 'fault' on Instance uuid 5ba6e623-d5a4-4f7f-ab8f-ede13517de39 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:55:52.054573 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-cfd55b29-faa5-4135-a77c-25f24a29984b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:52.064369 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-cfd55b29-faa5-4135-a77c-25f24a29984b tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1304 microversion: 2.1 time: 0.118307 Aug 26 08:55:52.065020 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 275/535] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:51 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:52.448020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-768bfbe3-23fe-4d4c-88f4-88f32753aeb4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:52.450745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-768bfbe3-23fe-4d4c-88f4-88f32753aeb4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:52.455897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-768bfbe3-23fe-4d4c-88f4-88f32753aeb4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:52.456390 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-768bfbe3-23fe-4d4c-88f4-88f32753aeb4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:52.456824 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-768bfbe3-23fe-4d4c-88f4-88f32753aeb4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:52.457565 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-768bfbe3-23fe-4d4c-88f4-88f32753aeb4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:52.458023 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-768bfbe3-23fe-4d4c-88f4-88f32753aeb4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:52.458528 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-768bfbe3-23fe-4d4c-88f4-88f32753aeb4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:52.629448 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-768bfbe3-23fe-4d4c-88f4-88f32753aeb4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:52.650335 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-768bfbe3-23fe-4d4c-88f4-88f32753aeb4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:52.652721 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-768bfbe3-23fe-4d4c-88f4-88f32753aeb4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:52.654578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-768bfbe3-23fe-4d4c-88f4-88f32753aeb4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.211216 Aug 26 08:55:52.655350 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 261/536] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:52 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:52.691350 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-faff0d1e-0d4f-4154-82f5-369878c0d2e0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:52.692246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-faff0d1e-0d4f-4154-82f5-369878c0d2e0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:52.699505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-faff0d1e-0d4f-4154-82f5-369878c0d2e0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:52.700003 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-faff0d1e-0d4f-4154-82f5-369878c0d2e0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:52.700442 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-faff0d1e-0d4f-4154-82f5-369878c0d2e0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:52.701162 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-faff0d1e-0d4f-4154-82f5-369878c0d2e0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:52.702096 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-faff0d1e-0d4f-4154-82f5-369878c0d2e0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:52.702250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-faff0d1e-0d4f-4154-82f5-369878c0d2e0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:52.852102 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-faff0d1e-0d4f-4154-82f5-369878c0d2e0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:52.864427 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-faff0d1e-0d4f-4154-82f5-369878c0d2e0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1255 microversion: 2.1 time: 0.178796 Aug 26 08:55:52.865749 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 276/537] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:52 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1255 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:52.890039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1be07fcc-0ada-418c-a0f0-29f7a4e90ab0 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:52.890661 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1be07fcc-0ada-418c-a0f0-29f7a4e90ab0 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:52.897137 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1be07fcc-0ada-418c-a0f0-29f7a4e90ab0 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:52.897623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1be07fcc-0ada-418c-a0f0-29f7a4e90ab0 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:52.898057 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1be07fcc-0ada-418c-a0f0-29f7a4e90ab0 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:52.898765 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1be07fcc-0ada-418c-a0f0-29f7a4e90ab0 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:52.899314 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1be07fcc-0ada-418c-a0f0-29f7a4e90ab0 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:52.899731 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1be07fcc-0ada-418c-a0f0-29f7a4e90ab0 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:53.047574 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1be07fcc-0ada-418c-a0f0-29f7a4e90ab0 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:53.056410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1be07fcc-0ada-418c-a0f0-29f7a4e90ab0 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.170249 Aug 26 08:55:53.057026 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 262/538] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:52 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:53.088182 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6a1b5d5f-204f-4433-8287-39abb0ad8d62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:53.088838 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6a1b5d5f-204f-4433-8287-39abb0ad8d62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:53.095712 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a1b5d5f-204f-4433-8287-39abb0ad8d62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:53.096203 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a1b5d5f-204f-4433-8287-39abb0ad8d62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:53.096637 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a1b5d5f-204f-4433-8287-39abb0ad8d62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:53.097371 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a1b5d5f-204f-4433-8287-39abb0ad8d62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:53.097822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a1b5d5f-204f-4433-8287-39abb0ad8d62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:53.098236 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a1b5d5f-204f-4433-8287-39abb0ad8d62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:53.133656 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a1b5d5f-204f-4433-8287-39abb0ad8d62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:53.133853 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a1b5d5f-204f-4433-8287-39abb0ad8d62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:53.135111 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a1b5d5f-204f-4433-8287-39abb0ad8d62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:53.135601 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-6a1b5d5f-204f-4433-8287-39abb0ad8d62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lazy-loading 'fault' on Instance uuid 5ba6e623-d5a4-4f7f-ab8f-ede13517de39 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:55:53.179554 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6a1b5d5f-204f-4433-8287-39abb0ad8d62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:53.188261 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6a1b5d5f-204f-4433-8287-39abb0ad8d62 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1304 microversion: 2.1 time: 0.104152 Aug 26 08:55:53.188880 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 277/539] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:53 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:53.678748 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0cffb3e5-a903-4f54-9c29-9329e99a9cb0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:53.679712 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-0cffb3e5-a903-4f54-9c29-9329e99a9cb0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:53.686587 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0cffb3e5-a903-4f54-9c29-9329e99a9cb0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:53.687160 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0cffb3e5-a903-4f54-9c29-9329e99a9cb0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:53.687753 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0cffb3e5-a903-4f54-9c29-9329e99a9cb0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:53.688464 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0cffb3e5-a903-4f54-9c29-9329e99a9cb0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:53.688938 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0cffb3e5-a903-4f54-9c29-9329e99a9cb0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:53.689601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0cffb3e5-a903-4f54-9c29-9329e99a9cb0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:53.865050 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0cffb3e5-a903-4f54-9c29-9329e99a9cb0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:53.875395 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0cffb3e5-a903-4f54-9c29-9329e99a9cb0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:53.877102 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0cffb3e5-a903-4f54-9c29-9329e99a9cb0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:53.881625 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-0cffb3e5-a903-4f54-9c29-9329e99a9cb0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.206684 Aug 26 08:55:53.882732 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 263/540] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:53 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:53.888654 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ec9312c7-3b02-45d1-9f50-922428935699 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:53.889290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ec9312c7-3b02-45d1-9f50-922428935699 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:53.898018 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ec9312c7-3b02-45d1-9f50-922428935699 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:53.899073 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ec9312c7-3b02-45d1-9f50-922428935699 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:53.899540 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ec9312c7-3b02-45d1-9f50-922428935699 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:53.900627 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ec9312c7-3b02-45d1-9f50-922428935699 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:53.901510 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ec9312c7-3b02-45d1-9f50-922428935699 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:53.902325 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ec9312c7-3b02-45d1-9f50-922428935699 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:53.924658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-4ac5ed52-cd64-4c6a-98af-b6310bd92a53 req-9dd14c02-fa73-4158-8fcd-2657cb6dd6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b220de56-45f9-4761-8d48-e80cbc874ca2", "tag": "22521262-299d-4e4d-9ba8-55935d2c7ebf"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:55:53.936081 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-4ac5ed52-cd64-4c6a-98af-b6310bd92a53 req-9dd14c02-fa73-4158-8fcd-2657cb6dd6ef service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:53.936982 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-4ac5ed52-cd64-4c6a-98af-b6310bd92a53 req-9dd14c02-fa73-4158-8fcd-2657cb6dd6ef service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:53.937835 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-4ac5ed52-cd64-4c6a-98af-b6310bd92a53 req-9dd14c02-fa73-4158-8fcd-2657cb6dd6ef service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:53.954775 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-4ac5ed52-cd64-4c6a-98af-b6310bd92a53 req-9dd14c02-fa73-4158-8fcd-2657cb6dd6ef service nova] Creating event network-changed:22521262-299d-4e4d-9ba8-55935d2c7ebf for instance b220de56-45f9-4761-8d48-e80cbc874ca2 on hv-cinder-85236 Aug 26 08:55:53.960337 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-4ac5ed52-cd64-4c6a-98af-b6310bd92a53 req-9dd14c02-fa73-4158-8fcd-2657cb6dd6ef service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040464 Aug 26 08:55:53.961383 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 264/541] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:55:53.998727 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ec9312c7-3b02-45d1-9f50-922428935699 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:54.012111 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ec9312c7-3b02-45d1-9f50-922428935699 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1255 microversion: 2.1 time: 0.127543 Aug 26 08:55:54.016003 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 278/542] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:53 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1255 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:54.079752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f4a139b7-eb31-4a41-ad06-d566e5db707c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:54.080661 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f4a139b7-eb31-4a41-ad06-d566e5db707c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:54.088757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f4a139b7-eb31-4a41-ad06-d566e5db707c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:54.089332 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f4a139b7-eb31-4a41-ad06-d566e5db707c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:54.089790 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f4a139b7-eb31-4a41-ad06-d566e5db707c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:54.090597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f4a139b7-eb31-4a41-ad06-d566e5db707c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:54.091106 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f4a139b7-eb31-4a41-ad06-d566e5db707c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:54.092970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f4a139b7-eb31-4a41-ad06-d566e5db707c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:54.210870 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8a00fffb-0b54-45d3-8749-232a06e2dfa9 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:54.211554 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8a00fffb-0b54-45d3-8749-232a06e2dfa9 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:54.219244 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a00fffb-0b54-45d3-8749-232a06e2dfa9 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:54.220025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a00fffb-0b54-45d3-8749-232a06e2dfa9 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:54.220456 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a00fffb-0b54-45d3-8749-232a06e2dfa9 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:54.221522 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a00fffb-0b54-45d3-8749-232a06e2dfa9 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:54.222002 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a00fffb-0b54-45d3-8749-232a06e2dfa9 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:54.222437 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a00fffb-0b54-45d3-8749-232a06e2dfa9 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:54.265452 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a00fffb-0b54-45d3-8749-232a06e2dfa9 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:54.266272 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a00fffb-0b54-45d3-8749-232a06e2dfa9 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:54.266920 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a00fffb-0b54-45d3-8749-232a06e2dfa9 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:54.267633 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-8a00fffb-0b54-45d3-8749-232a06e2dfa9 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lazy-loading 'fault' on Instance uuid 5ba6e623-d5a4-4f7f-ab8f-ede13517de39 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:55:54.278105 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f4a139b7-eb31-4a41-ad06-d566e5db707c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:54.292553 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f4a139b7-eb31-4a41-ad06-d566e5db707c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.217861 Aug 26 08:55:54.295311 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 265/543] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:54 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:54.415873 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8a00fffb-0b54-45d3-8749-232a06e2dfa9 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:54.425252 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8a00fffb-0b54-45d3-8749-232a06e2dfa9 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1304 microversion: 2.1 time: 0.218823 Aug 26 08:55:54.425859 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 279/544] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:54 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1304 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:54.912827 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b4298a35-f109-4eb0-a5bd-651e9d1a0c6e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:54.913941 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b4298a35-f109-4eb0-a5bd-651e9d1a0c6e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:54.922132 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4298a35-f109-4eb0-a5bd-651e9d1a0c6e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:54.922654 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4298a35-f109-4eb0-a5bd-651e9d1a0c6e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:54.923092 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4298a35-f109-4eb0-a5bd-651e9d1a0c6e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:54.923817 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4298a35-f109-4eb0-a5bd-651e9d1a0c6e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:54.924406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4298a35-f109-4eb0-a5bd-651e9d1a0c6e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:54.924687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4298a35-f109-4eb0-a5bd-651e9d1a0c6e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:55.034446 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-546d03c5-5be0-432d-9541-202464176e46 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:55.035229 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-546d03c5-5be0-432d-9541-202464176e46 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:55.042605 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-546d03c5-5be0-432d-9541-202464176e46 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:55.043709 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-546d03c5-5be0-432d-9541-202464176e46 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:55.044158 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-546d03c5-5be0-432d-9541-202464176e46 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:55.044891 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-546d03c5-5be0-432d-9541-202464176e46 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:55.045352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-546d03c5-5be0-432d-9541-202464176e46 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:55.045778 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-546d03c5-5be0-432d-9541-202464176e46 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:55.084762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b4298a35-f109-4eb0-a5bd-651e9d1a0c6e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:55.097101 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b4298a35-f109-4eb0-a5bd-651e9d1a0c6e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:55.099850 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b4298a35-f109-4eb0-a5bd-651e9d1a0c6e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:55.102015 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b4298a35-f109-4eb0-a5bd-651e9d1a0c6e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1806 microversion: 2.20 time: 0.196006 Aug 26 08:55:55.103021 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 266/545] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:54 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1806 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:55:55.133139 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-546d03c5-5be0-432d-9541-202464176e46 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:55.141180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-546d03c5-5be0-432d-9541-202464176e46 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1311 microversion: 2.1 time: 0.110656 Aug 26 08:55:55.141756 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 280/546] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:55 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:55.322748 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-49c5660b-21cf-4f0b-896e-e07e77f01ca2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:55.323967 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-49c5660b-21cf-4f0b-896e-e07e77f01ca2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:55.335473 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-49c5660b-21cf-4f0b-896e-e07e77f01ca2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:55.336417 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-49c5660b-21cf-4f0b-896e-e07e77f01ca2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:55.337669 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-49c5660b-21cf-4f0b-896e-e07e77f01ca2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:55.339299 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-49c5660b-21cf-4f0b-896e-e07e77f01ca2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:55.340392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-49c5660b-21cf-4f0b-896e-e07e77f01ca2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:55.341521 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-49c5660b-21cf-4f0b-896e-e07e77f01ca2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:55.453376 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-621c371c-08fc-4481-90d2-bd41e5f67432 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:55.455239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-621c371c-08fc-4481-90d2-bd41e5f67432 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:55.465690 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-621c371c-08fc-4481-90d2-bd41e5f67432 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:55.466748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-621c371c-08fc-4481-90d2-bd41e5f67432 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:55.467955 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-621c371c-08fc-4481-90d2-bd41e5f67432 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:55.470232 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-621c371c-08fc-4481-90d2-bd41e5f67432 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:55.471111 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-621c371c-08fc-4481-90d2-bd41e5f67432 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:55.471960 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-621c371c-08fc-4481-90d2-bd41e5f67432 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:55.531433 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-621c371c-08fc-4481-90d2-bd41e5f67432 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:55.532245 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-621c371c-08fc-4481-90d2-bd41e5f67432 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:55.532967 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-621c371c-08fc-4481-90d2-bd41e5f67432 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:55.534004 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-621c371c-08fc-4481-90d2-bd41e5f67432 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lazy-loading 'fault' on Instance uuid 5ba6e623-d5a4-4f7f-ab8f-ede13517de39 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:55:55.611990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-49c5660b-21cf-4f0b-896e-e07e77f01ca2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:55.629594 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-49c5660b-21cf-4f0b-896e-e07e77f01ca2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.314057 Aug 26 08:55:55.633742 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 267/547] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:55 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:55.634163 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-621c371c-08fc-4481-90d2-bd41e5f67432 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3ea95f39e24567af6f1be8f7e2a60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c2937d8e1243c185dab8e97f0a6e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:55.634459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=100 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:55.645383 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-621c371c-08fc-4481-90d2-bd41e5f67432 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 200 len: 1304 microversion: 2.1 time: 0.199136 Aug 26 08:55:55.646046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 281/548] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:55 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 1304 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:56.128509 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ce99722f-c02c-4d90-8750-f49821dfccd7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:56.129323 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ce99722f-c02c-4d90-8750-f49821dfccd7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:56.136755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ce99722f-c02c-4d90-8750-f49821dfccd7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:56.137238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ce99722f-c02c-4d90-8750-f49821dfccd7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:56.137666 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ce99722f-c02c-4d90-8750-f49821dfccd7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:56.138371 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ce99722f-c02c-4d90-8750-f49821dfccd7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:56.138928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ce99722f-c02c-4d90-8750-f49821dfccd7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:56.139385 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ce99722f-c02c-4d90-8750-f49821dfccd7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:56.164842 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7f93bc78-b95e-4be8-90f5-584fa2634ad8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:56.166004 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-7f93bc78-b95e-4be8-90f5-584fa2634ad8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:56.176976 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7f93bc78-b95e-4be8-90f5-584fa2634ad8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:56.177882 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7f93bc78-b95e-4be8-90f5-584fa2634ad8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:56.178553 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7f93bc78-b95e-4be8-90f5-584fa2634ad8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:56.179773 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7f93bc78-b95e-4be8-90f5-584fa2634ad8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:56.180713 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7f93bc78-b95e-4be8-90f5-584fa2634ad8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:56.181411 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7f93bc78-b95e-4be8-90f5-584fa2634ad8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:56.258757 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-7f93bc78-b95e-4be8-90f5-584fa2634ad8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:56.268170 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7f93bc78-b95e-4be8-90f5-584fa2634ad8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1311 microversion: 2.1 time: 0.109588 Aug 26 08:55:56.268854 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 282/549] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:56 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:56.313479 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ce99722f-c02c-4d90-8750-f49821dfccd7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:56.316105 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=100 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:55:56.325573 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ce99722f-c02c-4d90-8750-f49821dfccd7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:56.328763 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ce99722f-c02c-4d90-8750-f49821dfccd7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:56.331056 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ce99722f-c02c-4d90-8750-f49821dfccd7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1793 microversion: 2.20 time: 0.206333 Aug 26 08:55:56.332541 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 268/550] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:55:56 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1793 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:55:56.662205 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0ddd2097-26dc-4087-b2bf-82bb031227a4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:56.670354 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0ddd2097-26dc-4087-b2bf-82bb031227a4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:56.676526 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a5be8cf4-435a-43e8-8519-aeb99a651101 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:56.681272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a5be8cf4-435a-43e8-8519-aeb99a651101 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] [instance: 5ba6e623-d5a4-4f7f-ab8f-ede13517de39] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:56.696438 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a5be8cf4-435a-43e8-8519-aeb99a651101 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:56.697736 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a5be8cf4-435a-43e8-8519-aeb99a651101 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:56.698841 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a5be8cf4-435a-43e8-8519-aeb99a651101 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:56.700452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a5be8cf4-435a-43e8-8519-aeb99a651101 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:56.701169 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0ddd2097-26dc-4087-b2bf-82bb031227a4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:56.701808 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a5be8cf4-435a-43e8-8519-aeb99a651101 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:56.702106 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0ddd2097-26dc-4087-b2bf-82bb031227a4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:56.702845 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0ddd2097-26dc-4087-b2bf-82bb031227a4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:56.703269 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a5be8cf4-435a-43e8-8519-aeb99a651101 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:56.704116 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0ddd2097-26dc-4087-b2bf-82bb031227a4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:56.704894 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0ddd2097-26dc-4087-b2bf-82bb031227a4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:56.711506 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0ddd2097-26dc-4087-b2bf-82bb031227a4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:56.737265 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-a5be8cf4-435a-43e8-8519-aeb99a651101 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] HTTP exception thrown: Instance 5ba6e623-d5a4-4f7f-ab8f-ede13517de39 could not be found. Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a5be8cf4-435a-43e8-8519-aeb99a651101 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Request method failure captured: Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 HTTP/1.1 Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIpaBSMUzsOP1KcqUVzpiWiaBM1rji6nK8SzFhc_U_YOlLkVmZKkLVfMepnDds00x3_UBar4b5N3pkH1RSFj3hZj_KLgSUD2E2WQdorU5KG-vGahPapnx3tpJWUT5sr3nW8IR0i00925TyNPvEVnJfaGKMPU_MtB5i23h9dF392rVhM Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: d9c2937d8e1243c185dab8e97f0a6e90 Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-VolumesNegativeTest-223823414 Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 08:55:56.739757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 08:55:56.742597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d9c2937d8e1243c185dab8e97f0a6e90", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d9c2937d8e1243c185dab8e97f0a6e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d9c2937d8e1243c185dab8e97f0a6e90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d9c2937d8e1243c185dab8e97f0a6e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:55:56.742597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-VolumesNegativeTest-223823414 Aug 26 08:55:56.742597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: d9c2937d8e1243c185dab8e97f0a6e90 Aug 26 08:55:56.742597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-VolumesNegativeTest-223823414 Aug 26 08:55:56.742597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-VolumesNegativeTest-223823414-project Aug 26 08:55:56.742597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 08:55:56.742597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 08:55:56.742597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 3d3ea95f39e24567af6f1be8f7e2a60b Aug 26 08:55:56.742597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-VolumesNegativeTest-223823414-project Aug 26 08:55:56.742597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 08:55:56.742597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance 5ba6e623-d5a4-4f7f-ab8f-ede13517de39 could not be found. Aug 26 08:55:56.742597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '5ba6e623-d5a4-4f7f-ab8f-ede13517de39'} Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba6e623-d5a4-4f7f-ab8f-ede13517de39 could not be found. Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:55:56.744750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba6e623-d5a4-4f7f-ab8f-ede13517de39 could not be found. Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba6e623-d5a4-4f7f-ab8f-ede13517de39 could not be found. Aug 26 08:55:56.747791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:55:56.749840 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a5be8cf4-435a-43e8-8519-aeb99a651101 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] Returning 404 to user: Instance 5ba6e623-d5a4-4f7f-ab8f-ede13517de39 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:55:56.749840 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a5be8cf4-435a-43e8-8519-aeb99a651101 tempest-VolumesNegativeTest-223823414 tempest-VolumesNegativeTest-223823414-project] 10.222.0.71 "GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39" status: 404 len: 111 microversion: 2.1 time: 0.076888 Aug 26 08:55:56.749840 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 269/551] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:56 2022] GET /compute/v2.1/servers/5ba6e623-d5a4-4f7f-ab8f-ede13517de39 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:55:57.058148 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0ddd2097-26dc-4087-b2bf-82bb031227a4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:57.069186 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0ddd2097-26dc-4087-b2bf-82bb031227a4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.418099 Aug 26 08:55:57.078969 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 283/552] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:56 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:57.295246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0186b737-0b22-43ea-b923-c3999d972181 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:57.297027 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-0186b737-0b22-43ea-b923-c3999d972181 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:57.303887 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0186b737-0b22-43ea-b923-c3999d972181 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:57.304400 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0186b737-0b22-43ea-b923-c3999d972181 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:57.304820 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0186b737-0b22-43ea-b923-c3999d972181 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:57.306211 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0186b737-0b22-43ea-b923-c3999d972181 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:57.306773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0186b737-0b22-43ea-b923-c3999d972181 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:57.307108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0186b737-0b22-43ea-b923-c3999d972181 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:57.469116 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0186b737-0b22-43ea-b923-c3999d972181 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:57.481266 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-0186b737-0b22-43ea-b923-c3999d972181 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1317 microversion: 2.1 time: 0.190661 Aug 26 08:55:57.481876 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 270/553] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:57 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:58.092426 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7fd1c82f-aa63-4214-bc11-aa9bf476d01d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:58.093522 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-7fd1c82f-aa63-4214-bc11-aa9bf476d01d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:58.100534 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7fd1c82f-aa63-4214-bc11-aa9bf476d01d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:58.101023 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7fd1c82f-aa63-4214-bc11-aa9bf476d01d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:58.101455 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7fd1c82f-aa63-4214-bc11-aa9bf476d01d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:58.102235 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7fd1c82f-aa63-4214-bc11-aa9bf476d01d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:58.102916 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7fd1c82f-aa63-4214-bc11-aa9bf476d01d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:58.103217 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7fd1c82f-aa63-4214-bc11-aa9bf476d01d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:58.275035 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-7fd1c82f-aa63-4214-bc11-aa9bf476d01d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:58.288726 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7fd1c82f-aa63-4214-bc11-aa9bf476d01d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.199984 Aug 26 08:55:58.289703 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 284/554] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:58 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:55:58.508833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-63c2a2a9-66d8-46ce-8136-1c4fff46bcd6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:58.509576 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-63c2a2a9-66d8-46ce-8136-1c4fff46bcd6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:58.517694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-63c2a2a9-66d8-46ce-8136-1c4fff46bcd6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:58.518238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-63c2a2a9-66d8-46ce-8136-1c4fff46bcd6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:58.518430 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-63c2a2a9-66d8-46ce-8136-1c4fff46bcd6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:58.519113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-63c2a2a9-66d8-46ce-8136-1c4fff46bcd6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:58.519701 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-63c2a2a9-66d8-46ce-8136-1c4fff46bcd6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:58.520037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-63c2a2a9-66d8-46ce-8136-1c4fff46bcd6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:58.689059 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-63c2a2a9-66d8-46ce-8136-1c4fff46bcd6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:58.697855 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-63c2a2a9-66d8-46ce-8136-1c4fff46bcd6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.196879 Aug 26 08:55:58.698445 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 271/555] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:58 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:55:59.322922 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b0aaf549-8fe0-4092-8f4b-998df9f2a893 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:59.325260 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b0aaf549-8fe0-4092-8f4b-998df9f2a893 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:59.367670 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b0aaf549-8fe0-4092-8f4b-998df9f2a893 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:59.369239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b0aaf549-8fe0-4092-8f4b-998df9f2a893 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:59.370697 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b0aaf549-8fe0-4092-8f4b-998df9f2a893 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:59.373986 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b0aaf549-8fe0-4092-8f4b-998df9f2a893 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:59.375431 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b0aaf549-8fe0-4092-8f4b-998df9f2a893 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:59.388552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b0aaf549-8fe0-4092-8f4b-998df9f2a893 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:59.733810 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-be976ca1-1a68-44ce-a251-bb699fdf3f4b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:55:59.735121 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-be976ca1-1a68-44ce-a251-bb699fdf3f4b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:55:59.755478 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-be976ca1-1a68-44ce-a251-bb699fdf3f4b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:59.759256 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-be976ca1-1a68-44ce-a251-bb699fdf3f4b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:59.760254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-be976ca1-1a68-44ce-a251-bb699fdf3f4b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:59.761650 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-be976ca1-1a68-44ce-a251-bb699fdf3f4b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:55:59.762368 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-be976ca1-1a68-44ce-a251-bb699fdf3f4b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:55:59.763062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-be976ca1-1a68-44ce-a251-bb699fdf3f4b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:55:59.778489 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b0aaf549-8fe0-4092-8f4b-998df9f2a893 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:55:59.812427 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b0aaf549-8fe0-4092-8f4b-998df9f2a893 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.497461 Aug 26 08:55:59.813125 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 285/556] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:59 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:00.266143 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-be976ca1-1a68-44ce-a251-bb699fdf3f4b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:00.295173 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-c5b0ac11-6003-4c42-9207-c50007a7ed3f req-723a7e3b-170a-4e2e-b1da-040d20a7c00a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840c5e09-c3d3-4dd9-8812-fe9915934abf", "tag": "43e50f95-c491-4a41-90fb-e5677acb9448"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:56:00.298123 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-be976ca1-1a68-44ce-a251-bb699fdf3f4b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.568685 Aug 26 08:56:00.317107 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 272/557] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:55:59 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:56:00.325413 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-c5b0ac11-6003-4c42-9207-c50007a7ed3f req-723a7e3b-170a-4e2e-b1da-040d20a7c00a service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:00.326212 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-c5b0ac11-6003-4c42-9207-c50007a7ed3f req-723a7e3b-170a-4e2e-b1da-040d20a7c00a service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:00.326356 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-c5b0ac11-6003-4c42-9207-c50007a7ed3f req-723a7e3b-170a-4e2e-b1da-040d20a7c00a service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:00.354044 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-c5b0ac11-6003-4c42-9207-c50007a7ed3f req-723a7e3b-170a-4e2e-b1da-040d20a7c00a service nova] Creating event network-changed:43e50f95-c491-4a41-90fb-e5677acb9448 for instance 840c5e09-c3d3-4dd9-8812-fe9915934abf on hv-cinder-85236 Aug 26 08:56:00.367978 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-c5b0ac11-6003-4c42-9207-c50007a7ed3f req-723a7e3b-170a-4e2e-b1da-040d20a7c00a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076781 Aug 26 08:56:00.368933 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 286/558] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:56:00.839339 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1575f247-f91c-4307-953b-8b2d3ca8ab9e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:00.840143 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1575f247-f91c-4307-953b-8b2d3ca8ab9e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:00.849917 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1575f247-f91c-4307-953b-8b2d3ca8ab9e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:00.849917 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1575f247-f91c-4307-953b-8b2d3ca8ab9e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:00.849917 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1575f247-f91c-4307-953b-8b2d3ca8ab9e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:00.850598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1575f247-f91c-4307-953b-8b2d3ca8ab9e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:00.851114 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1575f247-f91c-4307-953b-8b2d3ca8ab9e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:00.851538 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1575f247-f91c-4307-953b-8b2d3ca8ab9e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:01.114374 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1575f247-f91c-4307-953b-8b2d3ca8ab9e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:01.128291 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1575f247-f91c-4307-953b-8b2d3ca8ab9e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.293520 Aug 26 08:56:01.129226 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 273/559] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:00 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:01.335092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-310564f8-6e43-4326-b567-d0de5dc697fc tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:01.337990 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-310564f8-6e43-4326-b567-d0de5dc697fc tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:01.351979 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-310564f8-6e43-4326-b567-d0de5dc697fc tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:01.353196 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-310564f8-6e43-4326-b567-d0de5dc697fc tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:01.354386 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-310564f8-6e43-4326-b567-d0de5dc697fc tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:01.356920 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-310564f8-6e43-4326-b567-d0de5dc697fc tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:01.358159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-310564f8-6e43-4326-b567-d0de5dc697fc tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:01.359166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-310564f8-6e43-4326-b567-d0de5dc697fc tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:01.590138 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-310564f8-6e43-4326-b567-d0de5dc697fc tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:01.603516 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-310564f8-6e43-4326-b567-d0de5dc697fc tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.278390 Aug 26 08:56:01.604906 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 287/560] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:01 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:02.152999 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-02d96421-089d-4f20-a05d-81a901cc6abf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:02.154821 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-02d96421-089d-4f20-a05d-81a901cc6abf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:02.155971 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=4 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:56:02.156936 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=16 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:56:02.167876 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-02d96421-089d-4f20-a05d-81a901cc6abf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:02.168371 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-02d96421-089d-4f20-a05d-81a901cc6abf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:02.168813 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-02d96421-089d-4f20-a05d-81a901cc6abf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:02.169813 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-02d96421-089d-4f20-a05d-81a901cc6abf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:02.170539 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-02d96421-089d-4f20-a05d-81a901cc6abf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:02.171378 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-02d96421-089d-4f20-a05d-81a901cc6abf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:02.433507 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-02d96421-089d-4f20-a05d-81a901cc6abf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:02.443169 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-02d96421-089d-4f20-a05d-81a901cc6abf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.294852 Aug 26 08:56:02.443949 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 274/561] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:02 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:02.649285 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-cec62b75-ffda-4001-bd52-6a0094831ee3 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:02.649992 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-cec62b75-ffda-4001-bd52-6a0094831ee3 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:02.652258 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=8 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:56:02.659379 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cec62b75-ffda-4001-bd52-6a0094831ee3 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:02.659834 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cec62b75-ffda-4001-bd52-6a0094831ee3 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:02.660275 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cec62b75-ffda-4001-bd52-6a0094831ee3 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:02.661038 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cec62b75-ffda-4001-bd52-6a0094831ee3 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:02.661499 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cec62b75-ffda-4001-bd52-6a0094831ee3 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:02.661912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cec62b75-ffda-4001-bd52-6a0094831ee3 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:02.888463 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-cec62b75-ffda-4001-bd52-6a0094831ee3 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:02.907312 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-cec62b75-ffda-4001-bd52-6a0094831ee3 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.273761 Aug 26 08:56:02.908156 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 288/562] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:02 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:03.476801 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c880dd29-8389-4949-bc4b-ffd54902cf99 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:03.480645 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c880dd29-8389-4949-bc4b-ffd54902cf99 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:03.510657 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c880dd29-8389-4949-bc4b-ffd54902cf99 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:03.511759 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c880dd29-8389-4949-bc4b-ffd54902cf99 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:03.512542 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c880dd29-8389-4949-bc4b-ffd54902cf99 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:03.514237 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c880dd29-8389-4949-bc4b-ffd54902cf99 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:03.516153 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c880dd29-8389-4949-bc4b-ffd54902cf99 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:03.517379 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c880dd29-8389-4949-bc4b-ffd54902cf99 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:03.698678 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c880dd29-8389-4949-bc4b-ffd54902cf99 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:03.711072 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c880dd29-8389-4949-bc4b-ffd54902cf99 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.242371 Aug 26 08:56:03.712675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 275/563] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:03 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:03.833816 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-edc71774-800b-4e68-8896-f92910161514 req-5aeb8bf3-89ba-477f-90a7-e4bdd77799b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b220de56-45f9-4761-8d48-e80cbc874ca2", "name": "network-vif-plugged", "status": "completed", "tag": "22521262-299d-4e4d-9ba8-55935d2c7ebf"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:56:03.844243 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-edc71774-800b-4e68-8896-f92910161514 req-5aeb8bf3-89ba-477f-90a7-e4bdd77799b1 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:03.844803 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-edc71774-800b-4e68-8896-f92910161514 req-5aeb8bf3-89ba-477f-90a7-e4bdd77799b1 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:03.845438 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-edc71774-800b-4e68-8896-f92910161514 req-5aeb8bf3-89ba-477f-90a7-e4bdd77799b1 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:03.858389 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-edc71774-800b-4e68-8896-f92910161514 req-5aeb8bf3-89ba-477f-90a7-e4bdd77799b1 service nova] Creating event network-vif-plugged:22521262-299d-4e4d-9ba8-55935d2c7ebf for instance b220de56-45f9-4761-8d48-e80cbc874ca2 on hv-cinder-85236 Aug 26 08:56:03.864672 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-edc71774-800b-4e68-8896-f92910161514 req-5aeb8bf3-89ba-477f-90a7-e4bdd77799b1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035421 Aug 26 08:56:03.865649 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 289/564] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:56:03.936317 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-52cc1ad6-247f-4940-89e3-86c8cd9b6087 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:03.937080 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-52cc1ad6-247f-4940-89e3-86c8cd9b6087 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:03.943785 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-52cc1ad6-247f-4940-89e3-86c8cd9b6087 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:03.944268 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-52cc1ad6-247f-4940-89e3-86c8cd9b6087 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:03.944775 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-52cc1ad6-247f-4940-89e3-86c8cd9b6087 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:03.945482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-52cc1ad6-247f-4940-89e3-86c8cd9b6087 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:03.945966 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-52cc1ad6-247f-4940-89e3-86c8cd9b6087 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:03.946383 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-52cc1ad6-247f-4940-89e3-86c8cd9b6087 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:04.150358 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-52cc1ad6-247f-4940-89e3-86c8cd9b6087 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:04.165197 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-52cc1ad6-247f-4940-89e3-86c8cd9b6087 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.232507 Aug 26 08:56:04.166243 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 276/565] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:03 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:04.415610 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a465c6eb-d967-44ed-81ac-8c9153355359 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:04.416623 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a465c6eb-d967-44ed-81ac-8c9153355359 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:04.428423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a465c6eb-d967-44ed-81ac-8c9153355359 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:04.429140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a465c6eb-d967-44ed-81ac-8c9153355359 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:04.429631 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a465c6eb-d967-44ed-81ac-8c9153355359 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:04.430571 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a465c6eb-d967-44ed-81ac-8c9153355359 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:04.431170 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a465c6eb-d967-44ed-81ac-8c9153355359 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:04.431714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a465c6eb-d967-44ed-81ac-8c9153355359 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:04.629984 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-a465c6eb-d967-44ed-81ac-8c9153355359 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lazy-loading 'services' on Instance uuid 18845e10-a764-495f-b6fb-9b0858c695af {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:56:04.744057 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-67166adf-1e31-419d-89ca-9272ba8b5713 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:04.745013 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-67166adf-1e31-419d-89ca-9272ba8b5713 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:04.757059 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-67166adf-1e31-419d-89ca-9272ba8b5713 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:04.757945 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-67166adf-1e31-419d-89ca-9272ba8b5713 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:04.758598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-67166adf-1e31-419d-89ca-9272ba8b5713 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:04.759819 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-67166adf-1e31-419d-89ca-9272ba8b5713 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:04.760593 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-67166adf-1e31-419d-89ca-9272ba8b5713 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:04.761306 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-67166adf-1e31-419d-89ca-9272ba8b5713 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:04.796348 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a465c6eb-d967-44ed-81ac-8c9153355359 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "DELETE /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/os-volume_attachments/f2d8c9c5-7e0f-4f31-a34e-bc692135a383" status: 202 len: 0 microversion: 2.1 time: 0.388763 Aug 26 08:56:04.797240 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 290/566] 10.222.0.71 () {58 vars in 1416 bytes} [Fri Aug 26 08:56:04 2022] DELETE /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/os-volume_attachments/f2d8c9c5-7e0f-4f31-a34e-bc692135a383 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:56:04.978998 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-67166adf-1e31-419d-89ca-9272ba8b5713 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:04.987361 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-67166adf-1e31-419d-89ca-9272ba8b5713 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.250118 Aug 26 08:56:04.988349 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 277/567] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:04 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:05.201191 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e8d205b7-5821-4bad-860d-7a953de449f4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:05.201777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e8d205b7-5821-4bad-860d-7a953de449f4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:05.211293 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e8d205b7-5821-4bad-860d-7a953de449f4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:05.212247 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e8d205b7-5821-4bad-860d-7a953de449f4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:05.213046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e8d205b7-5821-4bad-860d-7a953de449f4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:05.214397 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e8d205b7-5821-4bad-860d-7a953de449f4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:05.215298 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e8d205b7-5821-4bad-860d-7a953de449f4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:05.216086 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e8d205b7-5821-4bad-860d-7a953de449f4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:05.425690 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e8d205b7-5821-4bad-860d-7a953de449f4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:05.437846 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e8d205b7-5821-4bad-860d-7a953de449f4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.241433 Aug 26 08:56:05.438950 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 291/568] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:05 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:06.018040 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-27b7acec-09ca-468f-866a-47414d9397bc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:06.019126 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-27b7acec-09ca-468f-866a-47414d9397bc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:06.030672 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27b7acec-09ca-468f-866a-47414d9397bc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:06.031750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27b7acec-09ca-468f-866a-47414d9397bc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:06.032616 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27b7acec-09ca-468f-866a-47414d9397bc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:06.034033 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27b7acec-09ca-468f-866a-47414d9397bc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:06.034863 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27b7acec-09ca-468f-866a-47414d9397bc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:06.035609 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-27b7acec-09ca-468f-866a-47414d9397bc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:06.238344 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-27b7acec-09ca-468f-866a-47414d9397bc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:06.254763 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-27b7acec-09ca-468f-866a-47414d9397bc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.243014 Aug 26 08:56:06.256266 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 278/569] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:06 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:06.466420 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7b1582a7-3a43-4112-b571-118df5bf9fc1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:06.467541 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-7b1582a7-3a43-4112-b571-118df5bf9fc1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:06.480706 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7b1582a7-3a43-4112-b571-118df5bf9fc1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:06.481600 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7b1582a7-3a43-4112-b571-118df5bf9fc1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:06.482581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7b1582a7-3a43-4112-b571-118df5bf9fc1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:06.483202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7b1582a7-3a43-4112-b571-118df5bf9fc1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:06.483933 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7b1582a7-3a43-4112-b571-118df5bf9fc1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:06.484425 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7b1582a7-3a43-4112-b571-118df5bf9fc1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:06.707495 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-7b1582a7-3a43-4112-b571-118df5bf9fc1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:06.720822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7b1582a7-3a43-4112-b571-118df5bf9fc1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.258613 Aug 26 08:56:06.722029 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 292/570] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:06 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:56:07.290339 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-23ab02e5-4053-42c1-accc-771082a7bf83 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:07.291417 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-23ab02e5-4053-42c1-accc-771082a7bf83 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:07.304559 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23ab02e5-4053-42c1-accc-771082a7bf83 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:07.305293 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23ab02e5-4053-42c1-accc-771082a7bf83 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:07.306152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23ab02e5-4053-42c1-accc-771082a7bf83 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:07.307524 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23ab02e5-4053-42c1-accc-771082a7bf83 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:07.308612 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23ab02e5-4053-42c1-accc-771082a7bf83 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:07.309340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-23ab02e5-4053-42c1-accc-771082a7bf83 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:07.521278 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-23ab02e5-4053-42c1-accc-771082a7bf83 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:07.535663 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-23ab02e5-4053-42c1-accc-771082a7bf83 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.251079 Aug 26 08:56:07.536311 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 279/571] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:07 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:07.746328 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c640d4cb-e7df-4816-9b65-ef6e9e311232 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:07.746953 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c640d4cb-e7df-4816-9b65-ef6e9e311232 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:07.757043 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c640d4cb-e7df-4816-9b65-ef6e9e311232 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:07.758116 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c640d4cb-e7df-4816-9b65-ef6e9e311232 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:07.758842 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c640d4cb-e7df-4816-9b65-ef6e9e311232 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:07.759890 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c640d4cb-e7df-4816-9b65-ef6e9e311232 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:07.760369 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c640d4cb-e7df-4816-9b65-ef6e9e311232 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:07.761126 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c640d4cb-e7df-4816-9b65-ef6e9e311232 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:07.990171 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c640d4cb-e7df-4816-9b65-ef6e9e311232 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:08.023691 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c640d4cb-e7df-4816-9b65-ef6e9e311232 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.281410 Aug 26 08:56:08.036222 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 293/572] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:07 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:08.562056 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-7b0a99ed-3597-4b3e-9404-00ac02ad9d3e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:08.563229 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-7b0a99ed-3597-4b3e-9404-00ac02ad9d3e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:08.577815 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b0a99ed-3597-4b3e-9404-00ac02ad9d3e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:08.578647 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b0a99ed-3597-4b3e-9404-00ac02ad9d3e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:08.579655 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b0a99ed-3597-4b3e-9404-00ac02ad9d3e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:08.580887 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b0a99ed-3597-4b3e-9404-00ac02ad9d3e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:08.581724 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b0a99ed-3597-4b3e-9404-00ac02ad9d3e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:08.582426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b0a99ed-3597-4b3e-9404-00ac02ad9d3e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:08.793704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7b0a99ed-3597-4b3e-9404-00ac02ad9d3e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:08.806557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-7b0a99ed-3597-4b3e-9404-00ac02ad9d3e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.251073 Aug 26 08:56:08.807665 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 280/573] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:08 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:09.062588 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-34609d1d-fd18-4914-93a6-2a78853fd5c7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:09.063832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-34609d1d-fd18-4914-93a6-2a78853fd5c7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:09.075232 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-34609d1d-fd18-4914-93a6-2a78853fd5c7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:09.076649 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-34609d1d-fd18-4914-93a6-2a78853fd5c7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:09.077439 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-34609d1d-fd18-4914-93a6-2a78853fd5c7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:09.078779 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-34609d1d-fd18-4914-93a6-2a78853fd5c7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:09.080090 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-34609d1d-fd18-4914-93a6-2a78853fd5c7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:09.080596 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-34609d1d-fd18-4914-93a6-2a78853fd5c7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:09.306226 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-34609d1d-fd18-4914-93a6-2a78853fd5c7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:09.318833 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-34609d1d-fd18-4914-93a6-2a78853fd5c7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.263926 Aug 26 08:56:09.319801 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 294/574] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:09 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:09.845546 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-351d680c-c819-4261-b7be-28a2423e6004 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:09.846796 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-351d680c-c819-4261-b7be-28a2423e6004 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:09.857468 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-351d680c-c819-4261-b7be-28a2423e6004 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:09.858245 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-351d680c-c819-4261-b7be-28a2423e6004 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:09.859060 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-351d680c-c819-4261-b7be-28a2423e6004 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:09.860398 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-351d680c-c819-4261-b7be-28a2423e6004 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:09.861086 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-351d680c-c819-4261-b7be-28a2423e6004 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:09.861807 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-351d680c-c819-4261-b7be-28a2423e6004 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:10.051706 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-351d680c-c819-4261-b7be-28a2423e6004 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:10.062128 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-351d680c-c819-4261-b7be-28a2423e6004 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.224007 Aug 26 08:56:10.063134 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 281/575] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:09 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:10.342590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a8cf9a00-ba69-45cc-9ef6-cd8f8986d725 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:10.343390 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a8cf9a00-ba69-45cc-9ef6-cd8f8986d725 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:10.352440 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a8cf9a00-ba69-45cc-9ef6-cd8f8986d725 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:10.353246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a8cf9a00-ba69-45cc-9ef6-cd8f8986d725 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:10.353965 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a8cf9a00-ba69-45cc-9ef6-cd8f8986d725 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:10.355510 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a8cf9a00-ba69-45cc-9ef6-cd8f8986d725 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:10.356502 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a8cf9a00-ba69-45cc-9ef6-cd8f8986d725 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:10.357408 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a8cf9a00-ba69-45cc-9ef6-cd8f8986d725 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:10.581522 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a8cf9a00-ba69-45cc-9ef6-cd8f8986d725 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:10.596293 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a8cf9a00-ba69-45cc-9ef6-cd8f8986d725 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.257230 Aug 26 08:56:10.597322 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 295/576] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:10 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:11.095315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-00023e19-64a2-47b4-96ed-2aeac524c219 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:11.096278 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-00023e19-64a2-47b4-96ed-2aeac524c219 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:11.105142 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00023e19-64a2-47b4-96ed-2aeac524c219 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:11.105683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00023e19-64a2-47b4-96ed-2aeac524c219 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:11.106362 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00023e19-64a2-47b4-96ed-2aeac524c219 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:11.107484 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00023e19-64a2-47b4-96ed-2aeac524c219 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:11.109016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00023e19-64a2-47b4-96ed-2aeac524c219 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:11.109016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00023e19-64a2-47b4-96ed-2aeac524c219 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:11.356178 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-00023e19-64a2-47b4-96ed-2aeac524c219 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:11.367925 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-00023e19-64a2-47b4-96ed-2aeac524c219 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.277375 Aug 26 08:56:11.389823 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 282/577] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:11 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:11.628741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4b38fe06-b614-4b49-9edc-37f171f1ab8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:11.629918 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4b38fe06-b614-4b49-9edc-37f171f1ab8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:11.643693 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b38fe06-b614-4b49-9edc-37f171f1ab8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:11.644532 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b38fe06-b614-4b49-9edc-37f171f1ab8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:11.645289 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b38fe06-b614-4b49-9edc-37f171f1ab8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:11.646583 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b38fe06-b614-4b49-9edc-37f171f1ab8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:11.647413 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b38fe06-b614-4b49-9edc-37f171f1ab8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:11.648173 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b38fe06-b614-4b49-9edc-37f171f1ab8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:11.837840 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4b38fe06-b614-4b49-9edc-37f171f1ab8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:11.846479 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4b38fe06-b614-4b49-9edc-37f171f1ab8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.222272 Aug 26 08:56:11.847330 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 296/578] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:11 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:56:12.407704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-01744cde-9f91-46db-8d46-9d4a4dccb51c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:12.408813 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-01744cde-9f91-46db-8d46-9d4a4dccb51c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:12.420770 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01744cde-9f91-46db-8d46-9d4a4dccb51c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:12.421648 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01744cde-9f91-46db-8d46-9d4a4dccb51c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:12.422424 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01744cde-9f91-46db-8d46-9d4a4dccb51c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:12.423715 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01744cde-9f91-46db-8d46-9d4a4dccb51c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:12.424535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01744cde-9f91-46db-8d46-9d4a4dccb51c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:12.425284 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-01744cde-9f91-46db-8d46-9d4a4dccb51c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:12.660327 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-01744cde-9f91-46db-8d46-9d4a4dccb51c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:12.669089 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-01744cde-9f91-46db-8d46-9d4a4dccb51c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.269618 Aug 26 08:56:12.669701 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 283/579] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:12 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:12.868324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d7319ac2-5bd0-437b-be7a-aff3613119db tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:12.868962 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d7319ac2-5bd0-437b-be7a-aff3613119db tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:12.876438 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7319ac2-5bd0-437b-be7a-aff3613119db tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:12.876924 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7319ac2-5bd0-437b-be7a-aff3613119db tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:12.877358 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7319ac2-5bd0-437b-be7a-aff3613119db tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:12.878067 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7319ac2-5bd0-437b-be7a-aff3613119db tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:12.878525 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7319ac2-5bd0-437b-be7a-aff3613119db tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:12.878973 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7319ac2-5bd0-437b-be7a-aff3613119db tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:13.050405 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d7319ac2-5bd0-437b-be7a-aff3613119db tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:13.059752 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d7319ac2-5bd0-437b-be7a-aff3613119db tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.195404 Aug 26 08:56:13.060360 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 297/580] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:12 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:13.692715 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1d571362-6cdb-4afc-bb77-46d0a75f26b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:13.693339 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1d571362-6cdb-4afc-bb77-46d0a75f26b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:13.701419 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1d571362-6cdb-4afc-bb77-46d0a75f26b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:13.702113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1d571362-6cdb-4afc-bb77-46d0a75f26b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:13.702573 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1d571362-6cdb-4afc-bb77-46d0a75f26b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:13.703415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1d571362-6cdb-4afc-bb77-46d0a75f26b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:13.704062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1d571362-6cdb-4afc-bb77-46d0a75f26b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:13.704819 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1d571362-6cdb-4afc-bb77-46d0a75f26b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:13.862461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1d571362-6cdb-4afc-bb77-46d0a75f26b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:13.871934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1d571362-6cdb-4afc-bb77-46d0a75f26b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.183084 Aug 26 08:56:13.872473 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 284/581] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:13 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:14.088858 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d7a1af66-e6c0-426e-89ca-00a64bb47b6e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:14.089972 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d7a1af66-e6c0-426e-89ca-00a64bb47b6e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:14.101154 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7a1af66-e6c0-426e-89ca-00a64bb47b6e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:14.101988 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7a1af66-e6c0-426e-89ca-00a64bb47b6e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:14.102768 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7a1af66-e6c0-426e-89ca-00a64bb47b6e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:14.104073 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7a1af66-e6c0-426e-89ca-00a64bb47b6e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:14.104867 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7a1af66-e6c0-426e-89ca-00a64bb47b6e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:14.105300 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7a1af66-e6c0-426e-89ca-00a64bb47b6e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:14.303689 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d7a1af66-e6c0-426e-89ca-00a64bb47b6e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:14.312322 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d7a1af66-e6c0-426e-89ca-00a64bb47b6e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.231158 Aug 26 08:56:14.312933 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 298/582] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:14 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:14.894068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-25ba3548-d57e-442f-af20-76c4a07d98cf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:14.894990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-25ba3548-d57e-442f-af20-76c4a07d98cf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:14.901578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25ba3548-d57e-442f-af20-76c4a07d98cf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:14.902056 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25ba3548-d57e-442f-af20-76c4a07d98cf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:14.902482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25ba3548-d57e-442f-af20-76c4a07d98cf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:14.903224 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25ba3548-d57e-442f-af20-76c4a07d98cf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:14.903663 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25ba3548-d57e-442f-af20-76c4a07d98cf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:14.904070 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25ba3548-d57e-442f-af20-76c4a07d98cf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:15.100792 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-25ba3548-d57e-442f-af20-76c4a07d98cf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:15.109242 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-25ba3548-d57e-442f-af20-76c4a07d98cf tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.219323 Aug 26 08:56:15.109845 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 285/583] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:14 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:15.334035 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-fdea1320-0baf-493c-ac87-f6cc9f7f83a1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:15.335167 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-fdea1320-0baf-493c-ac87-f6cc9f7f83a1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:15.342656 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fdea1320-0baf-493c-ac87-f6cc9f7f83a1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:15.343189 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fdea1320-0baf-493c-ac87-f6cc9f7f83a1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:15.343680 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fdea1320-0baf-493c-ac87-f6cc9f7f83a1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:15.344396 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fdea1320-0baf-493c-ac87-f6cc9f7f83a1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:15.344850 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fdea1320-0baf-493c-ac87-f6cc9f7f83a1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:15.345280 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fdea1320-0baf-493c-ac87-f6cc9f7f83a1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:15.348919 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:56:15.548410 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-fdea1320-0baf-493c-ac87-f6cc9f7f83a1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:15.557536 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-fdea1320-0baf-493c-ac87-f6cc9f7f83a1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.227622 Aug 26 08:56:15.558207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 299/584] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:15 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:16.147663 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-77b14eab-ed98-485b-a402-87acafcc0b53 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:16.151438 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-77b14eab-ed98-485b-a402-87acafcc0b53 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:16.162139 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77b14eab-ed98-485b-a402-87acafcc0b53 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:16.163039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77b14eab-ed98-485b-a402-87acafcc0b53 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:16.163917 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77b14eab-ed98-485b-a402-87acafcc0b53 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:16.165295 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77b14eab-ed98-485b-a402-87acafcc0b53 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:16.165890 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77b14eab-ed98-485b-a402-87acafcc0b53 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:16.166329 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77b14eab-ed98-485b-a402-87acafcc0b53 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:16.183092 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=100 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:56:16.427372 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-77b14eab-ed98-485b-a402-87acafcc0b53 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:16.443102 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-77b14eab-ed98-485b-a402-87acafcc0b53 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.303183 Aug 26 08:56:16.444268 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 286/585] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:16 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:16.586244 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e63eb4f5-1a04-4053-8bbe-5398dd725075 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:16.587378 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e63eb4f5-1a04-4053-8bbe-5398dd725075 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:16.596184 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e63eb4f5-1a04-4053-8bbe-5398dd725075 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:16.597569 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e63eb4f5-1a04-4053-8bbe-5398dd725075 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:16.597777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e63eb4f5-1a04-4053-8bbe-5398dd725075 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:16.598676 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e63eb4f5-1a04-4053-8bbe-5398dd725075 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:16.599278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e63eb4f5-1a04-4053-8bbe-5398dd725075 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:16.599800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e63eb4f5-1a04-4053-8bbe-5398dd725075 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:16.777040 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e63eb4f5-1a04-4053-8bbe-5398dd725075 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:16.790341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e63eb4f5-1a04-4053-8bbe-5398dd725075 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.212661 Aug 26 08:56:16.791583 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 300/586] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:16 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:17.480318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-035d77a3-dd4a-4f06-bae9-0c694fc47df5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:17.481403 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-035d77a3-dd4a-4f06-bae9-0c694fc47df5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:17.494357 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-035d77a3-dd4a-4f06-bae9-0c694fc47df5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:17.496488 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-035d77a3-dd4a-4f06-bae9-0c694fc47df5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:17.497943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-035d77a3-dd4a-4f06-bae9-0c694fc47df5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:17.500488 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-035d77a3-dd4a-4f06-bae9-0c694fc47df5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:17.501137 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-035d77a3-dd4a-4f06-bae9-0c694fc47df5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:17.502691 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-035d77a3-dd4a-4f06-bae9-0c694fc47df5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:17.704716 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-035d77a3-dd4a-4f06-bae9-0c694fc47df5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:17.713730 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-035d77a3-dd4a-4f06-bae9-0c694fc47df5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.242188 Aug 26 08:56:17.714332 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 287/587] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:17 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:17.910452 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-01f03652-3575-4061-a394-112e22140cf8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:17.911630 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-01f03652-3575-4061-a394-112e22140cf8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:17.919850 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-01f03652-3575-4061-a394-112e22140cf8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:17.920409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-01f03652-3575-4061-a394-112e22140cf8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:17.920812 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-01f03652-3575-4061-a394-112e22140cf8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:17.921531 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-01f03652-3575-4061-a394-112e22140cf8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:17.922008 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-01f03652-3575-4061-a394-112e22140cf8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:17.923836 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-01f03652-3575-4061-a394-112e22140cf8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:17.945348 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-66df0bb0-1cd3-48ca-aeeb-bc491485cd8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:56:17.952701 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-66df0bb0-1cd3-48ca-aeeb-bc491485cd8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:17.953297 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-66df0bb0-1cd3-48ca-aeeb-bc491485cd8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:17.953748 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-66df0bb0-1cd3-48ca-aeeb-bc491485cd8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:17.980871 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-66df0bb0-1cd3-48ca-aeeb-bc491485cd8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Going to try to stop instance {{(pid=132217) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 08:56:18.049809 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-66df0bb0-1cd3-48ca-aeeb-bc491485cd8c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "POST /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/action" status: 202 len: 0 microversion: 2.1 time: 0.110759 Aug 26 08:56:18.055723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 288/588] 10.222.0.71 () {60 vars in 1278 bytes} [Fri Aug 26 08:56:17 2022] POST /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:56:18.065467 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b2fb60dc-0ba6-4633-9752-1ab5c17a6f0d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:18.066811 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b2fb60dc-0ba6-4633-9752-1ab5c17a6f0d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:18.078434 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b2fb60dc-0ba6-4633-9752-1ab5c17a6f0d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:18.079345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b2fb60dc-0ba6-4633-9752-1ab5c17a6f0d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:18.080118 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b2fb60dc-0ba6-4633-9752-1ab5c17a6f0d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:18.081354 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b2fb60dc-0ba6-4633-9752-1ab5c17a6f0d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:18.082074 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b2fb60dc-0ba6-4633-9752-1ab5c17a6f0d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:18.082780 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b2fb60dc-0ba6-4633-9752-1ab5c17a6f0d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:18.102853 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-01f03652-3575-4061-a394-112e22140cf8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:18.112898 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-01f03652-3575-4061-a394-112e22140cf8 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.206781 Aug 26 08:56:18.113493 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 301/589] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:17 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:18.295226 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b2fb60dc-0ba6-4633-9752-1ab5c17a6f0d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:18.309032 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b2fb60dc-0ba6-4633-9752-1ab5c17a6f0d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1726 microversion: 2.1 time: 0.251162 Aug 26 08:56:18.310161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 289/590] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:18 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1726 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:18.736710 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-bd5bf642-9ad9-4da4-9837-b7acb6a1cb0f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:18.737712 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-bd5bf642-9ad9-4da4-9837-b7acb6a1cb0f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:18.747773 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bd5bf642-9ad9-4da4-9837-b7acb6a1cb0f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:18.748574 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bd5bf642-9ad9-4da4-9837-b7acb6a1cb0f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:18.749320 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bd5bf642-9ad9-4da4-9837-b7acb6a1cb0f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:18.750369 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bd5bf642-9ad9-4da4-9837-b7acb6a1cb0f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:18.750859 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bd5bf642-9ad9-4da4-9837-b7acb6a1cb0f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:18.751279 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bd5bf642-9ad9-4da4-9837-b7acb6a1cb0f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:18.916969 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-bd5bf642-9ad9-4da4-9837-b7acb6a1cb0f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:18.926184 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-bd5bf642-9ad9-4da4-9837-b7acb6a1cb0f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.194771 Aug 26 08:56:18.926707 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 302/591] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:18 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:19.151208 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0f87fe92-99d2-415d-a721-22d604a7a23e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:19.152070 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-0f87fe92-99d2-415d-a721-22d604a7a23e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:19.161973 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0f87fe92-99d2-415d-a721-22d604a7a23e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:19.162944 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0f87fe92-99d2-415d-a721-22d604a7a23e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:19.163652 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0f87fe92-99d2-415d-a721-22d604a7a23e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:19.164682 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0f87fe92-99d2-415d-a721-22d604a7a23e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:19.165361 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0f87fe92-99d2-415d-a721-22d604a7a23e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:19.166080 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0f87fe92-99d2-415d-a721-22d604a7a23e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:19.320159 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0f87fe92-99d2-415d-a721-22d604a7a23e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:19.330094 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-0f87fe92-99d2-415d-a721-22d604a7a23e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.185372 Aug 26 08:56:19.330664 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 290/592] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:19 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:56:19.345680 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-15bda924-8fdd-4a4a-b470-bad8f7d6c197 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:19.346272 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-15bda924-8fdd-4a4a-b470-bad8f7d6c197 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:19.348729 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:56:19.354750 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-15bda924-8fdd-4a4a-b470-bad8f7d6c197 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:19.355284 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-15bda924-8fdd-4a4a-b470-bad8f7d6c197 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:19.355709 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-15bda924-8fdd-4a4a-b470-bad8f7d6c197 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:19.356413 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-15bda924-8fdd-4a4a-b470-bad8f7d6c197 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:19.356862 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-15bda924-8fdd-4a4a-b470-bad8f7d6c197 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:19.357285 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-15bda924-8fdd-4a4a-b470-bad8f7d6c197 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:19.507859 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-15bda924-8fdd-4a4a-b470-bad8f7d6c197 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:19.516788 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-15bda924-8fdd-4a4a-b470-bad8f7d6c197 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1680 microversion: 2.1 time: 0.174989 Aug 26 08:56:19.517316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 303/593] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:19 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:19.951793 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-bd2cec9c-4f7c-4e7a-9f08-a204b1092503 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:19.953518 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-bd2cec9c-4f7c-4e7a-9f08-a204b1092503 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:19.967064 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bd2cec9c-4f7c-4e7a-9f08-a204b1092503 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:19.967992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bd2cec9c-4f7c-4e7a-9f08-a204b1092503 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:19.968660 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bd2cec9c-4f7c-4e7a-9f08-a204b1092503 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:19.969852 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bd2cec9c-4f7c-4e7a-9f08-a204b1092503 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:19.970550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bd2cec9c-4f7c-4e7a-9f08-a204b1092503 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:19.971243 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bd2cec9c-4f7c-4e7a-9f08-a204b1092503 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:20.182427 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bd2cec9c-4f7c-4e7a-9f08-a204b1092503 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:20.191327 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-bd2cec9c-4f7c-4e7a-9f08-a204b1092503 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1367 microversion: 2.1 time: 0.244881 Aug 26 08:56:20.191926 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 291/594] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:19 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:20.351560 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-79674058-f501-4562-a170-9eb855538ad6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:20.352246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-79674058-f501-4562-a170-9eb855538ad6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:20.363303 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-79674058-f501-4562-a170-9eb855538ad6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:20.364174 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-79674058-f501-4562-a170-9eb855538ad6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:20.364904 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-79674058-f501-4562-a170-9eb855538ad6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:20.365736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-79674058-f501-4562-a170-9eb855538ad6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:20.366240 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-79674058-f501-4562-a170-9eb855538ad6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:20.366693 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-79674058-f501-4562-a170-9eb855538ad6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:20.538390 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-79674058-f501-4562-a170-9eb855538ad6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:20.539151 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e2fcc91d-fabf-41ce-9886-950091d621a1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:20.540202 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e2fcc91d-fabf-41ce-9886-950091d621a1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:20.548473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-79674058-f501-4562-a170-9eb855538ad6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.200760 Aug 26 08:56:20.549262 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 304/595] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:20 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:20.550701 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e2fcc91d-fabf-41ce-9886-950091d621a1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:20.551265 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e2fcc91d-fabf-41ce-9886-950091d621a1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:20.551723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e2fcc91d-fabf-41ce-9886-950091d621a1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:20.552442 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e2fcc91d-fabf-41ce-9886-950091d621a1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:20.552901 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e2fcc91d-fabf-41ce-9886-950091d621a1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:20.553470 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e2fcc91d-fabf-41ce-9886-950091d621a1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:20.746755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e2fcc91d-fabf-41ce-9886-950091d621a1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:20.762385 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e2fcc91d-fabf-41ce-9886-950091d621a1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1680 microversion: 2.1 time: 0.227756 Aug 26 08:56:20.763022 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 292/596] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:20 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:21.212819 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4a61ed79-1f9f-47e5-8f10-5cdae3b22ce3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:21.213479 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4a61ed79-1f9f-47e5-8f10-5cdae3b22ce3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:21.220233 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4a61ed79-1f9f-47e5-8f10-5cdae3b22ce3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:21.220814 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4a61ed79-1f9f-47e5-8f10-5cdae3b22ce3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:21.221119 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4a61ed79-1f9f-47e5-8f10-5cdae3b22ce3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:21.221872 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4a61ed79-1f9f-47e5-8f10-5cdae3b22ce3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:21.222346 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4a61ed79-1f9f-47e5-8f10-5cdae3b22ce3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:21.222738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4a61ed79-1f9f-47e5-8f10-5cdae3b22ce3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:21.392140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4a61ed79-1f9f-47e5-8f10-5cdae3b22ce3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:21.400881 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4a61ed79-1f9f-47e5-8f10-5cdae3b22ce3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1557 microversion: 2.1 time: 0.192424 Aug 26 08:56:21.401465 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 305/597] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:21 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1557 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:21.421819 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fe9fddde-839e-4ed4-9853-aaf550b40b51 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:21.422487 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-fe9fddde-839e-4ed4-9853-aaf550b40b51 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:21.429407 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fe9fddde-839e-4ed4-9853-aaf550b40b51 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:21.429889 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fe9fddde-839e-4ed4-9853-aaf550b40b51 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:21.430344 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fe9fddde-839e-4ed4-9853-aaf550b40b51 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:21.431141 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fe9fddde-839e-4ed4-9853-aaf550b40b51 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:21.431601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fe9fddde-839e-4ed4-9853-aaf550b40b51 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:21.432025 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fe9fddde-839e-4ed4-9853-aaf550b40b51 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:21.543926 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fe9fddde-839e-4ed4-9853-aaf550b40b51 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126195 Aug 26 08:56:21.544567 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 293/598] 10.222.0.71 () {58 vars in 1275 bytes} [Fri Aug 26 08:56:21 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:56:21.571171 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e911bc57-a2c5-49c7-8a93-5b0d2d355683 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:21.571786 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e911bc57-a2c5-49c7-8a93-5b0d2d355683 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:21.578695 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e911bc57-a2c5-49c7-8a93-5b0d2d355683 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:21.579220 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e911bc57-a2c5-49c7-8a93-5b0d2d355683 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:21.579648 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e911bc57-a2c5-49c7-8a93-5b0d2d355683 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:21.580389 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e911bc57-a2c5-49c7-8a93-5b0d2d355683 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:21.580837 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e911bc57-a2c5-49c7-8a93-5b0d2d355683 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:21.581260 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e911bc57-a2c5-49c7-8a93-5b0d2d355683 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:21.785715 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-cbd97b2d-089f-4b9f-8cf6-8d3808ccfe7c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:21.786416 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-cbd97b2d-089f-4b9f-8cf6-8d3808ccfe7c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:21.790444 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=69 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:56:21.798045 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cbd97b2d-089f-4b9f-8cf6-8d3808ccfe7c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:21.798730 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cbd97b2d-089f-4b9f-8cf6-8d3808ccfe7c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:21.799429 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cbd97b2d-089f-4b9f-8cf6-8d3808ccfe7c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:21.800404 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cbd97b2d-089f-4b9f-8cf6-8d3808ccfe7c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:21.800994 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cbd97b2d-089f-4b9f-8cf6-8d3808ccfe7c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:21.801938 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cbd97b2d-089f-4b9f-8cf6-8d3808ccfe7c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:21.861829 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e911bc57-a2c5-49c7-8a93-5b0d2d355683 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:21.871975 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e911bc57-a2c5-49c7-8a93-5b0d2d355683 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.304623 Aug 26 08:56:21.873116 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 306/599] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:21 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:22.013912 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-cbd97b2d-089f-4b9f-8cf6-8d3808ccfe7c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:22.030488 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-cbd97b2d-089f-4b9f-8cf6-8d3808ccfe7c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1680 microversion: 2.1 time: 0.249331 Aug 26 08:56:22.032032 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 294/600] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:21 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1680 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:56:22.772135 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-e83e256a-1add-4f1d-ae15-ba09cadab187 req-ec92fa15-e776-489e-ae53-5dcb10b2d2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b220de56-45f9-4761-8d48-e80cbc874ca2", "tag": "22521262-299d-4e4d-9ba8-55935d2c7ebf"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:56:22.787356 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-e83e256a-1add-4f1d-ae15-ba09cadab187 req-ec92fa15-e776-489e-ae53-5dcb10b2d2a1 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:22.788177 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-e83e256a-1add-4f1d-ae15-ba09cadab187 req-ec92fa15-e776-489e-ae53-5dcb10b2d2a1 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:22.788906 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-e83e256a-1add-4f1d-ae15-ba09cadab187 req-ec92fa15-e776-489e-ae53-5dcb10b2d2a1 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:22.802453 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-e83e256a-1add-4f1d-ae15-ba09cadab187 req-ec92fa15-e776-489e-ae53-5dcb10b2d2a1 service nova] Creating event network-changed:22521262-299d-4e4d-9ba8-55935d2c7ebf for instance b220de56-45f9-4761-8d48-e80cbc874ca2 on hv-cinder-85236 Aug 26 08:56:22.807840 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-e83e256a-1add-4f1d-ae15-ba09cadab187 req-ec92fa15-e776-489e-ae53-5dcb10b2d2a1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041100 Aug 26 08:56:22.808492 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 307/601] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:56:22.896024 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ee0a7522-9672-41a4-9f1d-c306bdcfa0f2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:22.897128 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ee0a7522-9672-41a4-9f1d-c306bdcfa0f2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:22.907954 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ee0a7522-9672-41a4-9f1d-c306bdcfa0f2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:22.908558 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ee0a7522-9672-41a4-9f1d-c306bdcfa0f2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:22.909452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ee0a7522-9672-41a4-9f1d-c306bdcfa0f2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:22.911066 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ee0a7522-9672-41a4-9f1d-c306bdcfa0f2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:22.912029 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ee0a7522-9672-41a4-9f1d-c306bdcfa0f2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:22.912874 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ee0a7522-9672-41a4-9f1d-c306bdcfa0f2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:23.065368 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-23fc89fa-7456-43ce-9bb6-9db1acb861ab tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:23.066571 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-23fc89fa-7456-43ce-9bb6-9db1acb861ab tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:23.074916 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-23fc89fa-7456-43ce-9bb6-9db1acb861ab tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:23.076001 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-23fc89fa-7456-43ce-9bb6-9db1acb861ab tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:23.076677 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-23fc89fa-7456-43ce-9bb6-9db1acb861ab tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:23.077815 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-23fc89fa-7456-43ce-9bb6-9db1acb861ab tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:23.078507 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-23fc89fa-7456-43ce-9bb6-9db1acb861ab tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:23.079505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-23fc89fa-7456-43ce-9bb6-9db1acb861ab tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:23.109476 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ee0a7522-9672-41a4-9f1d-c306bdcfa0f2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:23.128204 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ee0a7522-9672-41a4-9f1d-c306bdcfa0f2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.237797 Aug 26 08:56:23.129692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 295/602] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:22 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:23.354058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-23fc89fa-7456-43ce-9bb6-9db1acb861ab tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:23.362866 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-23fc89fa-7456-43ce-9bb6-9db1acb861ab tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1680 microversion: 2.1 time: 0.302424 Aug 26 08:56:23.363834 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 308/603] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:23 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1680 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:24.166420 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c487cfa6-0bb1-44fb-834f-2f3909de7090 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:24.167190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c487cfa6-0bb1-44fb-834f-2f3909de7090 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:24.175961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c487cfa6-0bb1-44fb-834f-2f3909de7090 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:24.176757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c487cfa6-0bb1-44fb-834f-2f3909de7090 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:24.177478 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c487cfa6-0bb1-44fb-834f-2f3909de7090 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:24.178332 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c487cfa6-0bb1-44fb-834f-2f3909de7090 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:24.178969 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c487cfa6-0bb1-44fb-834f-2f3909de7090 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:24.179730 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c487cfa6-0bb1-44fb-834f-2f3909de7090 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:24.353371 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c487cfa6-0bb1-44fb-834f-2f3909de7090 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:24.362713 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c487cfa6-0bb1-44fb-834f-2f3909de7090 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.202291 Aug 26 08:56:24.363324 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 296/604] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:24 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:24.392279 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c53c6036-736c-4f5b-bf06-356ad2a8e072 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:24.392895 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c53c6036-736c-4f5b-bf06-356ad2a8e072 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:24.399978 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c53c6036-736c-4f5b-bf06-356ad2a8e072 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:24.400406 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c53c6036-736c-4f5b-bf06-356ad2a8e072 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:24.400840 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c53c6036-736c-4f5b-bf06-356ad2a8e072 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:24.401579 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c53c6036-736c-4f5b-bf06-356ad2a8e072 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:24.402027 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c53c6036-736c-4f5b-bf06-356ad2a8e072 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:24.402476 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c53c6036-736c-4f5b-bf06-356ad2a8e072 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:24.551631 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c53c6036-736c-4f5b-bf06-356ad2a8e072 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:24.559931 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c53c6036-736c-4f5b-bf06-356ad2a8e072 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1680 microversion: 2.1 time: 0.171555 Aug 26 08:56:24.560497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 309/605] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:24 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:24.802975 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-f73ae55f-826d-4b61-a60b-02ee3352a859 req-78ceaa07-127f-4c8f-a93e-832ae7f1106a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "840c5e09-c3d3-4dd9-8812-fe9915934abf", "name": "network-vif-plugged", "status": "completed", "tag": "43e50f95-c491-4a41-90fb-e5677acb9448"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:56:24.814287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-f73ae55f-826d-4b61-a60b-02ee3352a859 req-78ceaa07-127f-4c8f-a93e-832ae7f1106a service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:24.816480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-f73ae55f-826d-4b61-a60b-02ee3352a859 req-78ceaa07-127f-4c8f-a93e-832ae7f1106a service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:24.818606 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-f73ae55f-826d-4b61-a60b-02ee3352a859 req-78ceaa07-127f-4c8f-a93e-832ae7f1106a service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:24.832673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-f73ae55f-826d-4b61-a60b-02ee3352a859 req-78ceaa07-127f-4c8f-a93e-832ae7f1106a service nova] Creating event network-vif-plugged:43e50f95-c491-4a41-90fb-e5677acb9448 for instance 840c5e09-c3d3-4dd9-8812-fe9915934abf on hv-cinder-85236 Aug 26 08:56:24.837997 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-f73ae55f-826d-4b61-a60b-02ee3352a859 req-78ceaa07-127f-4c8f-a93e-832ae7f1106a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038801 Aug 26 08:56:24.838958 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 297/606] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:56:25.386400 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-dfdd7294-e0fe-4b06-9922-1bdaa821be0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:25.387067 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-dfdd7294-e0fe-4b06-9922-1bdaa821be0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:25.396666 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dfdd7294-e0fe-4b06-9922-1bdaa821be0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:25.397680 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dfdd7294-e0fe-4b06-9922-1bdaa821be0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:25.397680 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dfdd7294-e0fe-4b06-9922-1bdaa821be0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:25.398423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dfdd7294-e0fe-4b06-9922-1bdaa821be0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:25.398990 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dfdd7294-e0fe-4b06-9922-1bdaa821be0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:25.399407 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dfdd7294-e0fe-4b06-9922-1bdaa821be0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:25.583409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-dfdd7294-e0fe-4b06-9922-1bdaa821be0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:25.587291 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6716911c-61b3-43e1-ad69-35931b77c928 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:25.587989 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6716911c-61b3-43e1-ad69-35931b77c928 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:25.593013 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-dfdd7294-e0fe-4b06-9922-1bdaa821be0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.212368 Aug 26 08:56:25.593733 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 310/607] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:25 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:25.595233 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6716911c-61b3-43e1-ad69-35931b77c928 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:25.595960 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6716911c-61b3-43e1-ad69-35931b77c928 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:25.596400 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6716911c-61b3-43e1-ad69-35931b77c928 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:25.597120 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6716911c-61b3-43e1-ad69-35931b77c928 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:25.597571 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6716911c-61b3-43e1-ad69-35931b77c928 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:25.597995 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6716911c-61b3-43e1-ad69-35931b77c928 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:25.742558 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6716911c-61b3-43e1-ad69-35931b77c928 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:25.751410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6716911c-61b3-43e1-ad69-35931b77c928 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1680 microversion: 2.1 time: 0.168275 Aug 26 08:56:25.752036 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 298/608] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:25 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:56:26.617608 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2bac2b73-0900-4d2a-9675-6a6ff0f8b832 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:26.618260 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2bac2b73-0900-4d2a-9675-6a6ff0f8b832 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:26.625277 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2bac2b73-0900-4d2a-9675-6a6ff0f8b832 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:26.625812 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2bac2b73-0900-4d2a-9675-6a6ff0f8b832 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:26.626192 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2bac2b73-0900-4d2a-9675-6a6ff0f8b832 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:26.626899 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2bac2b73-0900-4d2a-9675-6a6ff0f8b832 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:26.627361 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2bac2b73-0900-4d2a-9675-6a6ff0f8b832 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:26.627796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2bac2b73-0900-4d2a-9675-6a6ff0f8b832 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:26.773999 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e0b82732-ab88-4f97-b59c-2ef5b793adc6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:26.774679 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e0b82732-ab88-4f97-b59c-2ef5b793adc6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:26.781661 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e0b82732-ab88-4f97-b59c-2ef5b793adc6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:26.782157 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e0b82732-ab88-4f97-b59c-2ef5b793adc6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:26.782617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e0b82732-ab88-4f97-b59c-2ef5b793adc6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:26.783377 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e0b82732-ab88-4f97-b59c-2ef5b793adc6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:26.783828 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e0b82732-ab88-4f97-b59c-2ef5b793adc6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:26.784225 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e0b82732-ab88-4f97-b59c-2ef5b793adc6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:26.958619 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e0b82732-ab88-4f97-b59c-2ef5b793adc6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:26.967580 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e0b82732-ab88-4f97-b59c-2ef5b793adc6 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1680 microversion: 2.1 time: 0.197527 Aug 26 08:56:26.968344 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 299/609] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:26 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1680 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:27.036339 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2bac2b73-0900-4d2a-9675-6a6ff0f8b832 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:27.044831 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2bac2b73-0900-4d2a-9675-6a6ff0f8b832 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.431095 Aug 26 08:56:27.045449 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 311/610] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:26 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:27.989168 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-49b67e45-001a-4536-9069-c324dec45a2f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:27.989787 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-49b67e45-001a-4536-9069-c324dec45a2f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:27.996416 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-49b67e45-001a-4536-9069-c324dec45a2f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:27.996911 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-49b67e45-001a-4536-9069-c324dec45a2f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:27.997323 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-49b67e45-001a-4536-9069-c324dec45a2f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:27.998019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-49b67e45-001a-4536-9069-c324dec45a2f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:27.998498 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-49b67e45-001a-4536-9069-c324dec45a2f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:27.998937 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-49b67e45-001a-4536-9069-c324dec45a2f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:28.066117 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-643620ad-9903-4b5d-aff4-3ca818455af2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:28.066831 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-643620ad-9903-4b5d-aff4-3ca818455af2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:28.073933 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-643620ad-9903-4b5d-aff4-3ca818455af2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:28.074538 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-643620ad-9903-4b5d-aff4-3ca818455af2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:28.075094 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-643620ad-9903-4b5d-aff4-3ca818455af2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:28.075899 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-643620ad-9903-4b5d-aff4-3ca818455af2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:28.076437 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-643620ad-9903-4b5d-aff4-3ca818455af2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:28.076980 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-643620ad-9903-4b5d-aff4-3ca818455af2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:28.140581 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-49b67e45-001a-4536-9069-c324dec45a2f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:28.148664 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-49b67e45-001a-4536-9069-c324dec45a2f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1680 microversion: 2.1 time: 0.163380 Aug 26 08:56:28.149250 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 300/611] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:27 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:28.221561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-643620ad-9903-4b5d-aff4-3ca818455af2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:28.230625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-643620ad-9903-4b5d-aff4-3ca818455af2 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1359 microversion: 2.1 time: 0.168467 Aug 26 08:56:28.231280 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 312/612] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:28 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:56:29.171543 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-969a851e-154c-4145-b8e7-19a23fc770b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:29.172823 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-969a851e-154c-4145-b8e7-19a23fc770b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:29.178432 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-969a851e-154c-4145-b8e7-19a23fc770b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:29.178949 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-969a851e-154c-4145-b8e7-19a23fc770b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:29.179375 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-969a851e-154c-4145-b8e7-19a23fc770b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:29.180076 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-969a851e-154c-4145-b8e7-19a23fc770b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:29.180527 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-969a851e-154c-4145-b8e7-19a23fc770b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:29.180997 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-969a851e-154c-4145-b8e7-19a23fc770b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:29.254058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6b58a23c-3a38-42dd-b174-c2df59f8034e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:29.254670 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6b58a23c-3a38-42dd-b174-c2df59f8034e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:29.262246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b58a23c-3a38-42dd-b174-c2df59f8034e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:29.262724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b58a23c-3a38-42dd-b174-c2df59f8034e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:29.263173 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b58a23c-3a38-42dd-b174-c2df59f8034e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:29.263884 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b58a23c-3a38-42dd-b174-c2df59f8034e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:29.264323 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b58a23c-3a38-42dd-b174-c2df59f8034e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:29.264734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b58a23c-3a38-42dd-b174-c2df59f8034e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:29.375686 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-969a851e-154c-4145-b8e7-19a23fc770b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:29.384688 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-969a851e-154c-4145-b8e7-19a23fc770b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1680 microversion: 2.1 time: 0.217064 Aug 26 08:56:29.385273 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 301/613] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:29 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:29.415541 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6b58a23c-3a38-42dd-b174-c2df59f8034e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:29.423637 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6b58a23c-3a38-42dd-b174-c2df59f8034e tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1549 microversion: 2.1 time: 0.173622 Aug 26 08:56:29.424229 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 313/614] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:29 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:29.444893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f49785d9-074e-4ef9-ae38-839e800ea690 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:29.445563 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f49785d9-074e-4ef9-ae38-839e800ea690 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:29.453164 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f49785d9-074e-4ef9-ae38-839e800ea690 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:29.453721 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f49785d9-074e-4ef9-ae38-839e800ea690 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:29.454217 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f49785d9-074e-4ef9-ae38-839e800ea690 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:29.455066 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f49785d9-074e-4ef9-ae38-839e800ea690 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:29.455580 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f49785d9-074e-4ef9-ae38-839e800ea690 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:29.456174 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f49785d9-074e-4ef9-ae38-839e800ea690 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:29.612493 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f49785d9-074e-4ef9-ae38-839e800ea690 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:29.615130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:56:29.625212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f49785d9-074e-4ef9-ae38-839e800ea690 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1549 microversion: 2.1 time: 0.184219 Aug 26 08:56:29.626027 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 302/615] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:29 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1549 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:29.645931 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-73fde83a-7d7c-467a-85ab-ac8226d27d78 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:29.651385 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-73fde83a-7d7c-467a-85ab-ac8226d27d78 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:29.652270 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-73fde83a-7d7c-467a-85ab-ac8226d27d78 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Searching by: {'deleted': False, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c'} {{(pid=132218) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 26 08:56:29.660222 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-73fde83a-7d7c-467a-85ab-ac8226d27d78 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:29.660688 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-73fde83a-7d7c-467a-85ab-ac8226d27d78 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:29.661099 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-73fde83a-7d7c-467a-85ab-ac8226d27d78 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:29.661862 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-73fde83a-7d7c-467a-85ab-ac8226d27d78 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:29.662317 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-73fde83a-7d7c-467a-85ab-ac8226d27d78 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:29.662739 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-73fde83a-7d7c-467a-85ab-ac8226d27d78 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:29.764257 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.multi_cell_list [None req-73fde83a-7d7c-467a-85ab-ac8226d27d78 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132218) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 26 08:56:29.875259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-73fde83a-7d7c-467a-85ab-ac8226d27d78 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.232838 Aug 26 08:56:29.875965 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 314/616] 10.222.0.71 () {58 vars in 1125 bytes} [Fri Aug 26 08:56:29 2022] GET /compute/v2.1/servers => generated 343 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:56:29.889329 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-595adaa2-5d37-437a-94ab-fbb2fde3f3c9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:29.889991 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-595adaa2-5d37-437a-94ab-fbb2fde3f3c9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:29.897402 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-595adaa2-5d37-437a-94ab-fbb2fde3f3c9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:29.897884 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-595adaa2-5d37-437a-94ab-fbb2fde3f3c9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:29.898307 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-595adaa2-5d37-437a-94ab-fbb2fde3f3c9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:29.899155 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-595adaa2-5d37-437a-94ab-fbb2fde3f3c9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:29.899746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-595adaa2-5d37-437a-94ab-fbb2fde3f3c9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:29.900755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-595adaa2-5d37-437a-94ab-fbb2fde3f3c9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:30.047523 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-595adaa2-5d37-437a-94ab-fbb2fde3f3c9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:30.056740 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-595adaa2-5d37-437a-94ab-fbb2fde3f3c9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1549 microversion: 2.1 time: 0.172457 Aug 26 08:56:30.057342 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 303/617] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:29 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:30.410081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d4dbace5-510d-4706-8087-2f8234efdbd4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:30.410697 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d4dbace5-510d-4706-8087-2f8234efdbd4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:30.418658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d4dbace5-510d-4706-8087-2f8234efdbd4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:30.419243 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d4dbace5-510d-4706-8087-2f8234efdbd4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:30.419822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d4dbace5-510d-4706-8087-2f8234efdbd4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:30.420526 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d4dbace5-510d-4706-8087-2f8234efdbd4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:30.420972 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d4dbace5-510d-4706-8087-2f8234efdbd4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:30.421381 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d4dbace5-510d-4706-8087-2f8234efdbd4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:30.773563 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d4dbace5-510d-4706-8087-2f8234efdbd4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:30.782338 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d4dbace5-510d-4706-8087-2f8234efdbd4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1680 microversion: 2.1 time: 0.379734 Aug 26 08:56:30.782957 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 315/618] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:30 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1680 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:56:31.712044 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-de2988ea-1878-4967-88de-54e9d2585414 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f6b9a59-6e2d-41b2-b933-cb3091c1fb42"}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:56:31.714794 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-de2988ea-1878-4967-88de-54e9d2585414 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:31.722023 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de2988ea-1878-4967-88de-54e9d2585414 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:31.722504 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de2988ea-1878-4967-88de-54e9d2585414 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:31.722961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de2988ea-1878-4967-88de-54e9d2585414 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:31.723662 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de2988ea-1878-4967-88de-54e9d2585414 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:31.724106 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de2988ea-1878-4967-88de-54e9d2585414 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:31.724518 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de2988ea-1878-4967-88de-54e9d2585414 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:31.803813 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-58cd1456-299b-4a4b-a666-444cbb1fee91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:31.805369 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-58cd1456-299b-4a4b-a666-444cbb1fee91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:31.814716 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-58cd1456-299b-4a4b-a666-444cbb1fee91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:31.815710 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-58cd1456-299b-4a4b-a666-444cbb1fee91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:31.817372 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-58cd1456-299b-4a4b-a666-444cbb1fee91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:31.818136 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-58cd1456-299b-4a4b-a666-444cbb1fee91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:31.818598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-58cd1456-299b-4a4b-a666-444cbb1fee91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:31.819289 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-58cd1456-299b-4a4b-a666-444cbb1fee91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:31.822179 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=100 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:56:31.980476 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-58cd1456-299b-4a4b-a666-444cbb1fee91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:31.989066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-58cd1456-299b-4a4b-a666-444cbb1fee91 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1680 microversion: 2.1 time: 0.189101 Aug 26 08:56:31.989653 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 316/619] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:31 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:32.101801 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-de2988ea-1878-4967-88de-54e9d2585414 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "POST /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.395324 Aug 26 08:56:32.102417 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 304/620] 10.222.0.71 () {60 vars in 1323 bytes} [Fri Aug 26 08:56:31 2022] POST /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/os-volume_attachments => generated 194 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:56:33.012148 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2b16c41d-707f-42ac-ab19-cd6576dab75f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:33.012776 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2b16c41d-707f-42ac-ab19-cd6576dab75f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:33.019445 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2b16c41d-707f-42ac-ab19-cd6576dab75f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:33.019927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2b16c41d-707f-42ac-ab19-cd6576dab75f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:33.020350 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2b16c41d-707f-42ac-ab19-cd6576dab75f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:33.021108 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2b16c41d-707f-42ac-ab19-cd6576dab75f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:33.021559 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2b16c41d-707f-42ac-ab19-cd6576dab75f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:33.021975 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2b16c41d-707f-42ac-ab19-cd6576dab75f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:33.162144 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2b16c41d-707f-42ac-ab19-cd6576dab75f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:33.172927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2b16c41d-707f-42ac-ab19-cd6576dab75f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1680 microversion: 2.1 time: 0.164793 Aug 26 08:56:33.173802 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 317/621] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:33 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:56:34.202696 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3ef6fe53-bc36-4b1e-b596-3c638707249e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:34.203434 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3ef6fe53-bc36-4b1e-b596-3c638707249e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:34.210917 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ef6fe53-bc36-4b1e-b596-3c638707249e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:34.211440 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ef6fe53-bc36-4b1e-b596-3c638707249e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:34.211879 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ef6fe53-bc36-4b1e-b596-3c638707249e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:34.212631 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ef6fe53-bc36-4b1e-b596-3c638707249e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:34.213071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ef6fe53-bc36-4b1e-b596-3c638707249e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:34.213489 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ef6fe53-bc36-4b1e-b596-3c638707249e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:34.437558 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3ef6fe53-bc36-4b1e-b596-3c638707249e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:34.446335 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-3ef6fe53-bc36-4b1e-b596-3c638707249e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1680 microversion: 2.1 time: 0.249293 Aug 26 08:56:34.447014 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 305/622] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:34 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1680 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:35.470198 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8f995d30-3e26-400c-8e86-a95a1e5c930d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:35.470973 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8f995d30-3e26-400c-8e86-a95a1e5c930d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:35.482190 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8f995d30-3e26-400c-8e86-a95a1e5c930d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:35.483038 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8f995d30-3e26-400c-8e86-a95a1e5c930d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:35.483760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8f995d30-3e26-400c-8e86-a95a1e5c930d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:35.484959 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8f995d30-3e26-400c-8e86-a95a1e5c930d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:35.485732 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8f995d30-3e26-400c-8e86-a95a1e5c930d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:35.486431 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8f995d30-3e26-400c-8e86-a95a1e5c930d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:35.631207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8f995d30-3e26-400c-8e86-a95a1e5c930d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:35.639232 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8f995d30-3e26-400c-8e86-a95a1e5c930d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1657 microversion: 2.1 time: 0.174896 Aug 26 08:56:35.639815 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 318/623] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:35 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1657 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:35.662654 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-7b823724-49fa-49d6-ab19-56bf229a9ed4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:56:35.669528 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b823724-49fa-49d6-ab19-56bf229a9ed4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:35.670016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b823724-49fa-49d6-ab19-56bf229a9ed4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:35.670421 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b823724-49fa-49d6-ab19-56bf229a9ed4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:35.697668 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-7b823724-49fa-49d6-ab19-56bf229a9ed4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Going to try to start instance {{(pid=132217) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 08:56:35.750257 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-7b823724-49fa-49d6-ab19-56bf229a9ed4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "POST /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/action" status: 202 len: 0 microversion: 2.1 time: 0.090902 Aug 26 08:56:35.751046 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 306/624] 10.222.0.71 () {60 vars in 1278 bytes} [Fri Aug 26 08:56:35 2022] POST /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:56:35.760515 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-84f62162-310f-4deb-bc60-31ae0e4a452a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:35.761132 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-84f62162-310f-4deb-bc60-31ae0e4a452a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:35.768241 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-84f62162-310f-4deb-bc60-31ae0e4a452a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:35.768733 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-84f62162-310f-4deb-bc60-31ae0e4a452a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:35.769274 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-84f62162-310f-4deb-bc60-31ae0e4a452a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:35.779363 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-84f62162-310f-4deb-bc60-31ae0e4a452a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:35.779363 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-84f62162-310f-4deb-bc60-31ae0e4a452a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:35.779363 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-84f62162-310f-4deb-bc60-31ae0e4a452a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:35.960632 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-84f62162-310f-4deb-bc60-31ae0e4a452a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:35.969186 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-84f62162-310f-4deb-bc60-31ae0e4a452a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1666 microversion: 2.1 time: 0.212730 Aug 26 08:56:35.969794 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 319/625] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:35 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1666 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:37.001478 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c2bd26a2-0eea-46fb-9be4-eaddb323fe57 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:37.002150 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c2bd26a2-0eea-46fb-9be4-eaddb323fe57 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:37.009801 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2bd26a2-0eea-46fb-9be4-eaddb323fe57 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:37.010284 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2bd26a2-0eea-46fb-9be4-eaddb323fe57 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:37.010709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2bd26a2-0eea-46fb-9be4-eaddb323fe57 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:37.011460 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2bd26a2-0eea-46fb-9be4-eaddb323fe57 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:37.011909 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2bd26a2-0eea-46fb-9be4-eaddb323fe57 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:37.012330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2bd26a2-0eea-46fb-9be4-eaddb323fe57 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:37.158671 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c2bd26a2-0eea-46fb-9be4-eaddb323fe57 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:37.167267 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c2bd26a2-0eea-46fb-9be4-eaddb323fe57 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1666 microversion: 2.1 time: 0.170199 Aug 26 08:56:37.167866 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 307/626] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:36 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1666 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:38.190967 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3380430f-5b1b-4580-a769-5ea4cc0a9b81 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:38.191600 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3380430f-5b1b-4580-a769-5ea4cc0a9b81 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:38.198555 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3380430f-5b1b-4580-a769-5ea4cc0a9b81 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:38.199070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3380430f-5b1b-4580-a769-5ea4cc0a9b81 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:38.199493 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3380430f-5b1b-4580-a769-5ea4cc0a9b81 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:38.200201 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3380430f-5b1b-4580-a769-5ea4cc0a9b81 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:38.200642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3380430f-5b1b-4580-a769-5ea4cc0a9b81 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:38.201055 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3380430f-5b1b-4580-a769-5ea4cc0a9b81 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:38.354427 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3380430f-5b1b-4580-a769-5ea4cc0a9b81 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:38.364769 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3380430f-5b1b-4580-a769-5ea4cc0a9b81 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1670 microversion: 2.1 time: 0.177743 Aug 26 08:56:38.365351 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 320/627] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:38 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1670 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:40.840166 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-de0c8622-f5b1-495f-85f3-9be6edc4bdf0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:40.840764 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-de0c8622-f5b1-495f-85f3-9be6edc4bdf0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:40.847482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de0c8622-f5b1-495f-85f3-9be6edc4bdf0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:40.847961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de0c8622-f5b1-495f-85f3-9be6edc4bdf0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:40.848383 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de0c8622-f5b1-495f-85f3-9be6edc4bdf0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:40.849064 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de0c8622-f5b1-495f-85f3-9be6edc4bdf0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:40.849515 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de0c8622-f5b1-495f-85f3-9be6edc4bdf0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:40.849944 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de0c8622-f5b1-495f-85f3-9be6edc4bdf0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:40.984427 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-de0c8622-f5b1-495f-85f3-9be6edc4bdf0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:40.993918 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-de0c8622-f5b1-495f-85f3-9be6edc4bdf0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1595 microversion: 2.1 time: 0.157620 Aug 26 08:56:40.994494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 308/628] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:40 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:43.151726 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-53078598-2ffa-455b-b87a-92f4305a2010 req-6338a5b4-9242-4760-8254-0bd46bb869a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840c5e09-c3d3-4dd9-8812-fe9915934abf", "tag": "43e50f95-c491-4a41-90fb-e5677acb9448"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:56:43.157337 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:56:43.163828 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-53078598-2ffa-455b-b87a-92f4305a2010 req-6338a5b4-9242-4760-8254-0bd46bb869a1 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:43.164305 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-53078598-2ffa-455b-b87a-92f4305a2010 req-6338a5b4-9242-4760-8254-0bd46bb869a1 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:43.164730 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-53078598-2ffa-455b-b87a-92f4305a2010 req-6338a5b4-9242-4760-8254-0bd46bb869a1 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:43.179819 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-53078598-2ffa-455b-b87a-92f4305a2010 req-6338a5b4-9242-4760-8254-0bd46bb869a1 service nova] Creating event network-changed:43e50f95-c491-4a41-90fb-e5677acb9448 for instance 840c5e09-c3d3-4dd9-8812-fe9915934abf on hv-cinder-85236 Aug 26 08:56:43.185383 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-53078598-2ffa-455b-b87a-92f4305a2010 req-6338a5b4-9242-4760-8254-0bd46bb869a1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037465 Aug 26 08:56:43.186361 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 321/629] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:56:44.280516 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6c57511e-8e56-47c6-b385-ef0e09c733ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1492471970"}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:56:44.281139 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6c57511e-8e56-47c6-b385-ef0e09c733ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:44.291659 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c57511e-8e56-47c6-b385-ef0e09c733ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:44.292304 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c57511e-8e56-47c6-b385-ef0e09c733ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:44.292734 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c57511e-8e56-47c6-b385-ef0e09c733ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:44.293448 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c57511e-8e56-47c6-b385-ef0e09c733ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:44.293892 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c57511e-8e56-47c6-b385-ef0e09c733ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:44.294308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c57511e-8e56-47c6-b385-ef0e09c733ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:44.448969 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.network.security_group_api [None req-6c57511e-8e56-47c6-b385-ef0e09c733ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Adding security group 31c69cac-9709-43b6-b7b2-868d43622288 to port 43e50f95-c491-4a41-90fb-e5677acb9448 Aug 26 08:56:44.794749 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6c57511e-8e56-47c6-b385-ef0e09c733ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "POST /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/action" status: 202 len: 0 microversion: 2.1 time: 0.518869 Aug 26 08:56:44.795492 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 309/630] 10.222.0.71 () {60 vars in 1278 bytes} [Fri Aug 26 08:56:44 2022] POST /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 08:56:44.804570 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4247a44f-b966-4817-aefe-8e6ea72ebbd9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:56:44.806176 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4247a44f-b966-4817-aefe-8e6ea72ebbd9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:56:44.814373 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4247a44f-b966-4817-aefe-8e6ea72ebbd9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:44.815217 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4247a44f-b966-4817-aefe-8e6ea72ebbd9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:44.815800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4247a44f-b966-4817-aefe-8e6ea72ebbd9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:44.816875 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4247a44f-b966-4817-aefe-8e6ea72ebbd9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:44.817186 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4247a44f-b966-4817-aefe-8e6ea72ebbd9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:44.817643 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4247a44f-b966-4817-aefe-8e6ea72ebbd9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:44.979765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4247a44f-b966-4817-aefe-8e6ea72ebbd9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:56:44.988819 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4247a44f-b966-4817-aefe-8e6ea72ebbd9 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1761 microversion: 2.1 time: 0.188694 Aug 26 08:56:44.989387 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 322/631] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:56:44 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1761 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:56:45.200502 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-0e77f0b5-c943-46ce-952f-076707a8fd93 req-9a5afe58-c560-42e6-9aca-e5052a7c7ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840c5e09-c3d3-4dd9-8812-fe9915934abf", "tag": "43e50f95-c491-4a41-90fb-e5677acb9448"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:56:45.211277 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-0e77f0b5-c943-46ce-952f-076707a8fd93 req-9a5afe58-c560-42e6-9aca-e5052a7c7ac1 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:56:45.211860 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-0e77f0b5-c943-46ce-952f-076707a8fd93 req-9a5afe58-c560-42e6-9aca-e5052a7c7ac1 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:56:45.212331 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-0e77f0b5-c943-46ce-952f-076707a8fd93 req-9a5afe58-c560-42e6-9aca-e5052a7c7ac1 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:56:45.224923 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-0e77f0b5-c943-46ce-952f-076707a8fd93 req-9a5afe58-c560-42e6-9aca-e5052a7c7ac1 service nova] Creating event network-changed:43e50f95-c491-4a41-90fb-e5677acb9448 for instance 840c5e09-c3d3-4dd9-8812-fe9915934abf on hv-cinder-85236 Aug 26 08:56:45.230663 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-0e77f0b5-c943-46ce-952f-076707a8fd93 req-9a5afe58-c560-42e6-9aca-e5052a7c7ac1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034178 Aug 26 08:56:45.231354 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 310/632] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:57:05.059863 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=39 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:05.060588 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=37 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:05.061769 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 08:57:05.061769 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Fri Aug 26 08:57:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-volume_attachments (ip 10.222.0.71) !!! Aug 26 08:57:05.179882 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8bbf5dc9-a041-4d24-bb73-2c886bf705b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e182deb0-7571-4634-bddb-118bf51b22b3"}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:05.182368 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8bbf5dc9-a041-4d24-bb73-2c886bf705b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:05.188949 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8bbf5dc9-a041-4d24-bb73-2c886bf705b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:05.189436 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8bbf5dc9-a041-4d24-bb73-2c886bf705b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:05.189886 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8bbf5dc9-a041-4d24-bb73-2c886bf705b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:05.190597 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8bbf5dc9-a041-4d24-bb73-2c886bf705b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:05.191097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8bbf5dc9-a041-4d24-bb73-2c886bf705b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:05.191523 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8bbf5dc9-a041-4d24-bb73-2c886bf705b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:05.489893 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8bbf5dc9-a041-4d24-bb73-2c886bf705b7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "POST /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.434786 Aug 26 08:57:05.490517 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 323/633] 10.222.0.71 () {60 vars in 1323 bytes} [Fri Aug 26 08:57:05 2022] POST /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-volume_attachments => generated 194 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:57:08.620510 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=33 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:08.621439 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:08.740112 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b7b9f393-d434-4c47-967b-6208a5b2a389 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:08.740706 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b7b9f393-d434-4c47-967b-6208a5b2a389 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:08.747009 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b7b9f393-d434-4c47-967b-6208a5b2a389 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:08.747771 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b7b9f393-d434-4c47-967b-6208a5b2a389 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:08.748196 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b7b9f393-d434-4c47-967b-6208a5b2a389 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:08.749440 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b7b9f393-d434-4c47-967b-6208a5b2a389 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:08.749440 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b7b9f393-d434-4c47-967b-6208a5b2a389 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:08.749866 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b7b9f393-d434-4c47-967b-6208a5b2a389 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:08.782358 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b7b9f393-d434-4c47-967b-6208a5b2a389 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments/4bf255ff-b9a6-45ff-86b7-b68318d0d176" status: 200 len: 194 microversion: 2.20 time: 0.170782 Aug 26 08:57:08.782948 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 311/634] 10.222.0.71 () {60 vars in 1454 bytes} [Fri Aug 26 08:57:08 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments/4bf255ff-b9a6-45ff-86b7-b68318d0d176 => generated 194 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:57:08.859267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-317b0722-f155-4405-a9ed-14904cbe4c40 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:08.859907 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-317b0722-f155-4405-a9ed-14904cbe4c40 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:08.868318 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-317b0722-f155-4405-a9ed-14904cbe4c40 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:08.868808 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-317b0722-f155-4405-a9ed-14904cbe4c40 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:08.869238 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-317b0722-f155-4405-a9ed-14904cbe4c40 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:08.869948 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-317b0722-f155-4405-a9ed-14904cbe4c40 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:08.870393 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-317b0722-f155-4405-a9ed-14904cbe4c40 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:08.870811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-317b0722-f155-4405-a9ed-14904cbe4c40 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:08.984671 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-317b0722-f155-4405-a9ed-14904cbe4c40 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lazy-loading 'services' on Instance uuid 8de0d2d4-3218-426b-a548-91c5891780fa {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:57:09.082461 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-317b0722-f155-4405-a9ed-14904cbe4c40 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "DELETE /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments/4bf255ff-b9a6-45ff-86b7-b68318d0d176" status: 202 len: 0 microversion: 2.20 time: 0.231232 Aug 26 08:57:09.083193 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 324/635] 10.222.0.71 () {60 vars in 1457 bytes} [Fri Aug 26 08:57:08 2022] DELETE /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments/4bf255ff-b9a6-45ff-86b7-b68318d0d176 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:57:09.092760 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a2eef909-1dbe-49cd-a36d-64539e371dc5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:09.095482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a2eef909-1dbe-49cd-a36d-64539e371dc5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:09.103708 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a2eef909-1dbe-49cd-a36d-64539e371dc5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:09.104204 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a2eef909-1dbe-49cd-a36d-64539e371dc5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:09.104630 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a2eef909-1dbe-49cd-a36d-64539e371dc5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:09.105351 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a2eef909-1dbe-49cd-a36d-64539e371dc5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:09.105799 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a2eef909-1dbe-49cd-a36d-64539e371dc5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:09.106212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a2eef909-1dbe-49cd-a36d-64539e371dc5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:09.141479 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a2eef909-1dbe-49cd-a36d-64539e371dc5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053060 Aug 26 08:57:09.142056 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 312/636] 10.222.0.71 () {60 vars in 1343 bytes} [Fri Aug 26 08:57:09 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:57:10.158795 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-008d21b9-5203-435f-9829-7a3011e1e65a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:10.161400 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-008d21b9-5203-435f-9829-7a3011e1e65a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:10.170296 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-008d21b9-5203-435f-9829-7a3011e1e65a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:10.171030 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-008d21b9-5203-435f-9829-7a3011e1e65a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:10.171650 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-008d21b9-5203-435f-9829-7a3011e1e65a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:10.172541 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-008d21b9-5203-435f-9829-7a3011e1e65a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:10.173092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-008d21b9-5203-435f-9829-7a3011e1e65a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:10.173662 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-008d21b9-5203-435f-9829-7a3011e1e65a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:10.208079 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-008d21b9-5203-435f-9829-7a3011e1e65a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054736 Aug 26 08:57:10.208677 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 325/637] 10.222.0.71 () {60 vars in 1343 bytes} [Fri Aug 26 08:57:10 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:57:11.223949 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8f0ea446-2247-47c4-bae4-79cd6da0167a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:11.227220 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8f0ea446-2247-47c4-bae4-79cd6da0167a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:11.238979 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f0ea446-2247-47c4-bae4-79cd6da0167a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:11.239854 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f0ea446-2247-47c4-bae4-79cd6da0167a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:11.240305 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f0ea446-2247-47c4-bae4-79cd6da0167a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:11.241078 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f0ea446-2247-47c4-bae4-79cd6da0167a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:11.241524 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f0ea446-2247-47c4-bae4-79cd6da0167a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:11.241994 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f0ea446-2247-47c4-bae4-79cd6da0167a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:11.274586 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8f0ea446-2247-47c4-bae4-79cd6da0167a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054763 Aug 26 08:57:11.275251 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 313/638] 10.222.0.71 () {60 vars in 1343 bytes} [Fri Aug 26 08:57:11 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:57:12.290454 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a092f9d1-0307-494f-b9c3-1bf836acd447 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:12.292526 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a092f9d1-0307-494f-b9c3-1bf836acd447 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:12.300100 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a092f9d1-0307-494f-b9c3-1bf836acd447 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:12.300581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a092f9d1-0307-494f-b9c3-1bf836acd447 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:12.301086 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a092f9d1-0307-494f-b9c3-1bf836acd447 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:12.301778 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a092f9d1-0307-494f-b9c3-1bf836acd447 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:12.302225 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a092f9d1-0307-494f-b9c3-1bf836acd447 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:12.302640 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a092f9d1-0307-494f-b9c3-1bf836acd447 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:12.333653 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a092f9d1-0307-494f-b9c3-1bf836acd447 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049105 Aug 26 08:57:12.334254 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 326/639] 10.222.0.71 () {60 vars in 1343 bytes} [Fri Aug 26 08:57:12 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:57:13.079290 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-438b0530-03f1-479e-b993-f929e5aff87f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:13.081477 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-438b0530-03f1-479e-b993-f929e5aff87f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:13.088165 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-438b0530-03f1-479e-b993-f929e5aff87f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:13.088642 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-438b0530-03f1-479e-b993-f929e5aff87f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:13.089066 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-438b0530-03f1-479e-b993-f929e5aff87f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:13.089749 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-438b0530-03f1-479e-b993-f929e5aff87f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:13.090201 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-438b0530-03f1-479e-b993-f929e5aff87f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:13.090612 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-438b0530-03f1-479e-b993-f929e5aff87f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:13.114211 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-438b0530-03f1-479e-b993-f929e5aff87f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lazy-loading 'flavor' on Instance uuid 1704235c-9819-4980-9ee0-b46ecd91de2e {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:57:13.252309 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-438b0530-03f1-479e-b993-f929e5aff87f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "POST /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/action" status: 200 len: 32 microversion: 2.1 time: 0.177232 Aug 26 08:57:13.252906 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 314/640] 10.222.0.71 () {60 vars in 1278 bytes} [Fri Aug 26 08:57:13 2022] POST /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 08:57:13.265191 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-dc19832f-5f9d-4ceb-bfc7-0d2621efc741 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:13.265802 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-dc19832f-5f9d-4ceb-bfc7-0d2621efc741 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:13.272045 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc19832f-5f9d-4ceb-bfc7-0d2621efc741 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:13.272530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc19832f-5f9d-4ceb-bfc7-0d2621efc741 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:13.272965 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc19832f-5f9d-4ceb-bfc7-0d2621efc741 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:13.273710 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc19832f-5f9d-4ceb-bfc7-0d2621efc741 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:13.274156 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc19832f-5f9d-4ceb-bfc7-0d2621efc741 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:13.274571 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc19832f-5f9d-4ceb-bfc7-0d2621efc741 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:13.347101 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-5eab2c77-72bb-4e28-802e-58b633f24556 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:13.351386 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-5eab2c77-72bb-4e28-802e-58b633f24556 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:13.358569 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5eab2c77-72bb-4e28-802e-58b633f24556 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:13.359227 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5eab2c77-72bb-4e28-802e-58b633f24556 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:13.359530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5eab2c77-72bb-4e28-802e-58b633f24556 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:13.360240 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5eab2c77-72bb-4e28-802e-58b633f24556 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:13.360676 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5eab2c77-72bb-4e28-802e-58b633f24556 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:13.361357 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5eab2c77-72bb-4e28-802e-58b633f24556 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:13.397550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-5eab2c77-72bb-4e28-802e-58b633f24556 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055158 Aug 26 08:57:13.398147 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 315/641] 10.222.0.71 () {60 vars in 1343 bytes} [Fri Aug 26 08:57:13 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 08:57:13.472315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-dc19832f-5f9d-4ceb-bfc7-0d2621efc741 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:13.481496 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-dc19832f-5f9d-4ceb-bfc7-0d2621efc741 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.220332 Aug 26 08:57:13.482065 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 327/642] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:13 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:14.413442 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2f00a620-5393-4afc-88eb-7bd3187c8ddd tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:14.415596 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2f00a620-5393-4afc-88eb-7bd3187c8ddd tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:14.422750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2f00a620-5393-4afc-88eb-7bd3187c8ddd tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:14.423194 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2f00a620-5393-4afc-88eb-7bd3187c8ddd tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:14.423631 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2f00a620-5393-4afc-88eb-7bd3187c8ddd tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:14.424326 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2f00a620-5393-4afc-88eb-7bd3187c8ddd tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:14.424778 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2f00a620-5393-4afc-88eb-7bd3187c8ddd tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:14.425202 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2f00a620-5393-4afc-88eb-7bd3187c8ddd tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:14.455817 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2f00a620-5393-4afc-88eb-7bd3187c8ddd tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048705 Aug 26 08:57:14.456383 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 316/643] 10.222.0.71 () {60 vars in 1343 bytes} [Fri Aug 26 08:57:14 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:14.504062 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e9a7d688-c053-4bb2-b941-bccdaba1352d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:14.505889 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e9a7d688-c053-4bb2-b941-bccdaba1352d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:14.513113 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e9a7d688-c053-4bb2-b941-bccdaba1352d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:14.513602 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e9a7d688-c053-4bb2-b941-bccdaba1352d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:14.514035 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e9a7d688-c053-4bb2-b941-bccdaba1352d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:14.514746 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e9a7d688-c053-4bb2-b941-bccdaba1352d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:14.515331 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e9a7d688-c053-4bb2-b941-bccdaba1352d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:14.515784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e9a7d688-c053-4bb2-b941-bccdaba1352d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:14.522898 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3e9f9268-03d5-4761-bd26-7a210076ada5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:14.523639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3e9f9268-03d5-4761-bd26-7a210076ada5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:14.530072 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3e9f9268-03d5-4761-bd26-7a210076ada5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:14.530557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3e9f9268-03d5-4761-bd26-7a210076ada5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:14.531019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3e9f9268-03d5-4761-bd26-7a210076ada5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:14.531741 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3e9f9268-03d5-4761-bd26-7a210076ada5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:14.532187 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3e9f9268-03d5-4761-bd26-7a210076ada5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:14.532606 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3e9f9268-03d5-4761-bd26-7a210076ada5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:14.559351 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3e9f9268-03d5-4761-bd26-7a210076ada5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Going to try to terminate instance {{(pid=132217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 08:57:14.644965 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-3e9f9268-03d5-4761-bd26-7a210076ada5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "DELETE /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 204 len: 0 microversion: 2.20 time: 0.125754 Aug 26 08:57:14.645924 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 317/644] 10.222.0.71 () {60 vars in 1280 bytes} [Fri Aug 26 08:57:14 2022] DELETE /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 08:57:14.654807 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-09fe2bda-c63c-4408-b4c5-ebea57f182dc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:14.655647 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-09fe2bda-c63c-4408-b4c5-ebea57f182dc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:14.660288 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e9a7d688-c053-4bb2-b941-bccdaba1352d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:14.661971 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09fe2bda-c63c-4408-b4c5-ebea57f182dc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:14.662453 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09fe2bda-c63c-4408-b4c5-ebea57f182dc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:14.662880 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09fe2bda-c63c-4408-b4c5-ebea57f182dc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:14.663601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09fe2bda-c63c-4408-b4c5-ebea57f182dc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:14.664068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09fe2bda-c63c-4408-b4c5-ebea57f182dc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:14.664502 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-09fe2bda-c63c-4408-b4c5-ebea57f182dc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:14.670114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e9a7d688-c053-4bb2-b941-bccdaba1352d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.169945 Aug 26 08:57:14.670745 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 328/645] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:14 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:14.814303 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-09fe2bda-c63c-4408-b4c5-ebea57f182dc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:14.827530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-09fe2bda-c63c-4408-b4c5-ebea57f182dc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:14.829823 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-09fe2bda-c63c-4408-b4c5-ebea57f182dc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:14.831700 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-09fe2bda-c63c-4408-b4c5-ebea57f182dc tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.180989 Aug 26 08:57:14.832578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 318/646] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:14 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:15.691649 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b98d7e3e-b1ff-4227-8898-1719b85e905b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:15.692249 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b98d7e3e-b1ff-4227-8898-1719b85e905b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:15.699525 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b98d7e3e-b1ff-4227-8898-1719b85e905b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:15.700009 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b98d7e3e-b1ff-4227-8898-1719b85e905b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:15.700435 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b98d7e3e-b1ff-4227-8898-1719b85e905b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:15.701121 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b98d7e3e-b1ff-4227-8898-1719b85e905b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:15.701566 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b98d7e3e-b1ff-4227-8898-1719b85e905b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:15.701973 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b98d7e3e-b1ff-4227-8898-1719b85e905b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:15.849926 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b98d7e3e-b1ff-4227-8898-1719b85e905b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:15.856686 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1fbcb74c-c584-4d98-8209-03113b290b87 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:15.857311 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1fbcb74c-c584-4d98-8209-03113b290b87 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:15.859148 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b98d7e3e-b1ff-4227-8898-1719b85e905b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.171409 Aug 26 08:57:15.859761 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 329/647] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:15 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:15.864263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1fbcb74c-c584-4d98-8209-03113b290b87 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:15.864743 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1fbcb74c-c584-4d98-8209-03113b290b87 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:15.865170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1fbcb74c-c584-4d98-8209-03113b290b87 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:15.865865 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1fbcb74c-c584-4d98-8209-03113b290b87 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:15.866308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1fbcb74c-c584-4d98-8209-03113b290b87 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:15.866728 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1fbcb74c-c584-4d98-8209-03113b290b87 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:16.020577 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1fbcb74c-c584-4d98-8209-03113b290b87 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:16.029699 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1fbcb74c-c584-4d98-8209-03113b290b87 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:16.031171 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1fbcb74c-c584-4d98-8209-03113b290b87 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:16.032412 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1fbcb74c-c584-4d98-8209-03113b290b87 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.179915 Aug 26 08:57:16.032985 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 319/648] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:15 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:16.881301 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-44096867-2532-4fa7-b207-f2973a2925e6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:16.882084 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-44096867-2532-4fa7-b207-f2973a2925e6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:16.889141 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-44096867-2532-4fa7-b207-f2973a2925e6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:16.889632 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-44096867-2532-4fa7-b207-f2973a2925e6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:16.890059 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-44096867-2532-4fa7-b207-f2973a2925e6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:16.890771 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-44096867-2532-4fa7-b207-f2973a2925e6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:16.891246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-44096867-2532-4fa7-b207-f2973a2925e6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:16.891642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-44096867-2532-4fa7-b207-f2973a2925e6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:17.050945 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-44096867-2532-4fa7-b207-f2973a2925e6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:17.056107 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ba737016-8844-435c-a927-51e26060a379 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:17.057010 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ba737016-8844-435c-a927-51e26060a379 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:17.059888 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-44096867-2532-4fa7-b207-f2973a2925e6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.182723 Aug 26 08:57:17.060509 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 330/649] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:16 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:17.064864 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba737016-8844-435c-a927-51e26060a379 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:17.065516 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba737016-8844-435c-a927-51e26060a379 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:17.066075 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba737016-8844-435c-a927-51e26060a379 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:17.066843 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba737016-8844-435c-a927-51e26060a379 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:17.067317 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba737016-8844-435c-a927-51e26060a379 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:17.067788 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba737016-8844-435c-a927-51e26060a379 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:17.234028 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ba737016-8844-435c-a927-51e26060a379 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:17.242735 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ba737016-8844-435c-a927-51e26060a379 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:17.244168 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ba737016-8844-435c-a927-51e26060a379 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:17.245349 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ba737016-8844-435c-a927-51e26060a379 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.193498 Aug 26 08:57:17.245894 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 320/650] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:17 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:18.081766 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-35719d31-2853-41d1-becb-2c5ca36a8b7a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:18.082366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-35719d31-2853-41d1-becb-2c5ca36a8b7a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:18.088897 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35719d31-2853-41d1-becb-2c5ca36a8b7a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:18.089382 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35719d31-2853-41d1-becb-2c5ca36a8b7a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:18.089813 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35719d31-2853-41d1-becb-2c5ca36a8b7a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:18.090516 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35719d31-2853-41d1-becb-2c5ca36a8b7a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:18.090997 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35719d31-2853-41d1-becb-2c5ca36a8b7a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:18.091419 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35719d31-2853-41d1-becb-2c5ca36a8b7a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:18.276006 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f603a726-b9f7-4a47-9ed5-75289ca01743 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:18.277469 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f603a726-b9f7-4a47-9ed5-75289ca01743 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:18.285754 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f603a726-b9f7-4a47-9ed5-75289ca01743 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:18.286252 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f603a726-b9f7-4a47-9ed5-75289ca01743 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:18.286738 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f603a726-b9f7-4a47-9ed5-75289ca01743 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:18.287702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f603a726-b9f7-4a47-9ed5-75289ca01743 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:18.288490 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f603a726-b9f7-4a47-9ed5-75289ca01743 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:18.288769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f603a726-b9f7-4a47-9ed5-75289ca01743 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:18.347059 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-35719d31-2853-41d1-becb-2c5ca36a8b7a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:18.356381 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-35719d31-2853-41d1-becb-2c5ca36a8b7a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.278544 Aug 26 08:57:18.357196 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 331/651] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:18 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:18.433352 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f603a726-b9f7-4a47-9ed5-75289ca01743 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:18.442796 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f603a726-b9f7-4a47-9ed5-75289ca01743 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:18.444356 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f603a726-b9f7-4a47-9ed5-75289ca01743 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:18.445557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f603a726-b9f7-4a47-9ed5-75289ca01743 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1721 microversion: 2.20 time: 0.175581 Aug 26 08:57:18.451687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 321/652] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:18 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:19.130484 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-85b2330b-e370-422e-8cda-b5ba8ad512ef req-c41713ef-685b-46fb-a19a-8dc4360fb1ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0d2d4-3218-426b-a548-91c5891780fa", "name": "network-vif-deleted", "tag": "61d58bf1-2d6c-4df7-8638-a30df721d2e9"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:19.144527 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-85b2330b-e370-422e-8cda-b5ba8ad512ef req-c41713ef-685b-46fb-a19a-8dc4360fb1ce service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:19.145019 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-85b2330b-e370-422e-8cda-b5ba8ad512ef req-c41713ef-685b-46fb-a19a-8dc4360fb1ce service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:19.145449 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-85b2330b-e370-422e-8cda-b5ba8ad512ef req-c41713ef-685b-46fb-a19a-8dc4360fb1ce service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:19.160750 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-85b2330b-e370-422e-8cda-b5ba8ad512ef req-c41713ef-685b-46fb-a19a-8dc4360fb1ce service nova] Creating event network-vif-deleted:61d58bf1-2d6c-4df7-8638-a30df721d2e9 for instance 8de0d2d4-3218-426b-a548-91c5891780fa on hv-cinder-85236 Aug 26 08:57:19.167695 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-85b2330b-e370-422e-8cda-b5ba8ad512ef req-c41713ef-685b-46fb-a19a-8dc4360fb1ce service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041029 Aug 26 08:57:19.168310 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 332/653] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:57:19.379494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fa16f4ce-6662-4623-861b-446431ba4f93 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:19.380283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-fa16f4ce-6662-4623-861b-446431ba4f93 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:19.387661 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa16f4ce-6662-4623-861b-446431ba4f93 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:19.388406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa16f4ce-6662-4623-861b-446431ba4f93 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:19.389032 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa16f4ce-6662-4623-861b-446431ba4f93 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:19.389964 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa16f4ce-6662-4623-861b-446431ba4f93 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:19.390840 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa16f4ce-6662-4623-861b-446431ba4f93 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:19.391315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa16f4ce-6662-4623-861b-446431ba4f93 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:19.471888 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:19.472687 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:19.479351 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:19.480109 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:19.480773 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:19.481477 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:19.482189 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:19.483071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:19.527481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:19.528280 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:19.541008 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:19.541962 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lazy-loading 'fault' on Instance uuid 8de0d2d4-3218-426b-a548-91c5891780fa {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:57:19.556445 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-fa16f4ce-6662-4623-861b-446431ba4f93 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:19.568026 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fa16f4ce-6662-4623-861b-446431ba4f93 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.192327 Aug 26 08:57:19.571586 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 322/654] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:19 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:19.601738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:19.611328 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:19.613082 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:19.614499 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-355fa649-51b1-452c-a738-ad0780eb6919 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 200 len: 1371 microversion: 2.20 time: 0.148245 Aug 26 08:57:19.615225 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 333/655] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:19 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:20.591805 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1ad052a5-c06d-45c5-8b50-d859b1dd22c7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:20.592411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1ad052a5-c06d-45c5-8b50-d859b1dd22c7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:20.599728 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1ad052a5-c06d-45c5-8b50-d859b1dd22c7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:20.600263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1ad052a5-c06d-45c5-8b50-d859b1dd22c7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:20.600719 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1ad052a5-c06d-45c5-8b50-d859b1dd22c7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:20.601450 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1ad052a5-c06d-45c5-8b50-d859b1dd22c7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:20.601983 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1ad052a5-c06d-45c5-8b50-d859b1dd22c7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:20.602399 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1ad052a5-c06d-45c5-8b50-d859b1dd22c7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:20.638081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ed6fa2eb-118e-43b1-bb28-96338d7c30c1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:20.639473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ed6fa2eb-118e-43b1-bb28-96338d7c30c1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:20.648034 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ed6fa2eb-118e-43b1-bb28-96338d7c30c1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:20.648858 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ed6fa2eb-118e-43b1-bb28-96338d7c30c1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:20.649459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ed6fa2eb-118e-43b1-bb28-96338d7c30c1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:20.650200 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ed6fa2eb-118e-43b1-bb28-96338d7c30c1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:20.650665 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ed6fa2eb-118e-43b1-bb28-96338d7c30c1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:20.653193 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ed6fa2eb-118e-43b1-bb28-96338d7c30c1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:20.669987 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-ed6fa2eb-118e-43b1-bb28-96338d7c30c1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] HTTP exception thrown: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ed6fa2eb-118e-43b1-bb28-96338d7c30c1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Request method failure captured: Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa HTTP/1.1 Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCImqwYI1puUrXBaVS0u8EIJAhXUypyZcgYcA6hR1_JGaV3vf4CttppK3hMXMvRnUMW2vCCVwt7eo62btClLXsaXiR7f7_uyq0-OdwjLUTE6xxp6IvybejR_0XnDaPC9Dlnj0KBs_lKg_n15wEqhzCuu0hRhlSR7e-Wj6vnH9GPPvc0o Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 8ed7993eba324f94a1b0f7fc23401f0f Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 08:57:20.671736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 08:57:20.673868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_8ed7993eba324f94a1b0f7fc23401f0f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:57:20.673868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 08:57:20.673868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 8ed7993eba324f94a1b0f7fc23401f0f Aug 26 08:57:20.673868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 08:57:20.673868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-AttachVolumeShelveTestJSON-648548185-project Aug 26 08:57:20.673868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 08:57:20.673868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 08:57:20.673868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 63e1c5a24be04ca4abd5d5109c5763f8 Aug 26 08:57:20.673868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-AttachVolumeShelveTestJSON-648548185-project Aug 26 08:57:20.673868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 08:57:20.673868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 08:57:20.673868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': '8de0d2d4-3218-426b-a548-91c5891780fa'} Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:57:20.674822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 08:57:20.677344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:20.678480 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ed6fa2eb-118e-43b1-bb28-96338d7c30c1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Returning 404 to user: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:57:20.678480 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ed6fa2eb-118e-43b1-bb28-96338d7c30c1 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 404 len: 111 microversion: 2.20 time: 0.039285 Aug 26 08:57:20.678480 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 334/656] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:20 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 26 08:57:20.683489 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1c1fc81b-6311-4275-a70c-5529f6677781 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '.version_select at 0x7f1367ec18b0>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:20.707261 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1c1fc81b-6311-4275-a70c-5529f6677781 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401257981" status: 204 len: 0 microversion: 2.20 time: 0.027577 Aug 26 08:57:20.708058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 335/657] 10.222.0.71 () {60 vars in 1262 bytes} [Fri Aug 26 08:57:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401257981 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 08:57:20.791422 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1ad052a5-c06d-45c5-8b50-d859b1dd22c7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:20.801027 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:20.813006 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1ad052a5-c06d-45c5-8b50-d859b1dd22c7 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.225044 Aug 26 08:57:20.817228 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 323/658] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:20 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:21.528399 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-bd7324df-bd3d-45df-8d83-a8f3b20c86b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Action: 'create', calling method: .version_select at 0x7f136c074820>, body: {"keypair": {"name": "tempest-keypair-1813474503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMHxpcypa+r9ksofXi7paSl3RwSVgLP9QEytHl9G4axdXVMwxQIUhD2OnSQY/G80jiNEYhK+JoSjhte9/7/x+aVvBse1xr5xNF1T0sTzytNZnUK7psZKfYUqAQ+E0nGhQ=="}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:21.547020 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-bd7324df-bd3d-45df-8d83-a8f3b20c86b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Getting quotas for project 8ed7993eba324f94a1b0f7fc23401f0f. Resources: {'key_pairs'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:57:21.551677 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-bd7324df-bd3d-45df-8d83-a8f3b20c86b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Getting quotas for user 63e1c5a24be04ca4abd5d5109c5763f8 and project 8ed7993eba324f94a1b0f7fc23401f0f. Resources: {'key_pairs'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:57:21.577228 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-bd7324df-bd3d-45df-8d83-a8f3b20c86b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.054829 Aug 26 08:57:21.578058 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 336/659] 10.222.0.71 () {62 vars in 1200 bytes} [Fri Aug 26 08:57:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 08:57:21.837881 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-19de2eb9-f7c5-4c99-901d-d4888a5ab464 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:21.838470 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-19de2eb9-f7c5-4c99-901d-d4888a5ab464 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:21.846675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-19de2eb9-f7c5-4c99-901d-d4888a5ab464 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:21.847636 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-19de2eb9-f7c5-4c99-901d-d4888a5ab464 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:21.848070 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-19de2eb9-f7c5-4c99-901d-d4888a5ab464 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:21.848785 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-19de2eb9-f7c5-4c99-901d-d4888a5ab464 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:21.849266 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-19de2eb9-f7c5-4c99-901d-d4888a5ab464 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:21.849743 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-19de2eb9-f7c5-4c99-901d-d4888a5ab464 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:21.992802 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-19de2eb9-f7c5-4c99-901d-d4888a5ab464 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:22.002837 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-19de2eb9-f7c5-4c99-901d-d4888a5ab464 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.169483 Aug 26 08:57:22.003812 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 324/660] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:21 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:22.915417 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-443307224", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ca2f64c-caf6-4358-8808-4c0656856257"}], "security_groups": [{"name": "tempest-securitygroup--773854491"}], "key_name": "tempest-keypair-1813474503", "user_data": "}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:23.023640 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.network.neutron [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] validate_networks() for [('3ca2f64c-caf6-4358-8808-4c0656856257', None, None, None, None, None)] {{(pid=132218) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:57:23.026757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e4b42704-19b5-423f-b866-4a08fde8591f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:23.027717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e4b42704-19b5-423f-b866-4a08fde8591f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:23.036021 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4b42704-19b5-423f-b866-4a08fde8591f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:23.036759 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4b42704-19b5-423f-b866-4a08fde8591f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:23.037339 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4b42704-19b5-423f-b866-4a08fde8591f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:23.038157 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4b42704-19b5-423f-b866-4a08fde8591f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:23.038645 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4b42704-19b5-423f-b866-4a08fde8591f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:23.039212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4b42704-19b5-423f-b866-4a08fde8591f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:23.204737 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e4b42704-19b5-423f-b866-4a08fde8591f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:23.215964 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e4b42704-19b5-423f-b866-4a08fde8591f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.192806 Aug 26 08:57:23.215964 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 325/661] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:23 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:57:23.535736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Flavor limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:57:23.536162 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Image limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:57:23.536627 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Flavor pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:57:23.537025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Image pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:57:23.537428 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:57:23.548982 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:23.549492 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:23.550293 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:23.551122 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:23.551583 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:23.552013 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:23.571016 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Getting quotas for project 8ed7993eba324f94a1b0f7fc23401f0f. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:57:23.575727 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Getting quotas for user 63e1c5a24be04ca4abd5d5109c5763f8 and project 8ed7993eba324f94a1b0f7fc23401f0f. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:57:23.591638 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Going to run 1 instances... {{(pid=132218) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:57:23.594149 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132218) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:57:23.648057 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-db77af97-208b-4a05-a8ee-e9266db14cc4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.737578 Aug 26 08:57:23.648742 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 337/662] 10.222.0.71 () {62 vars in 1188 bytes} [Fri Aug 26 08:57:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 26 08:57:23.660668 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-eadd8a81-ad43-4929-8a17-ab43cceb1772 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:23.661373 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-eadd8a81-ad43-4929-8a17-ab43cceb1772 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:23.719014 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-eadd8a81-ad43-4929-8a17-ab43cceb1772 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:23.726743 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-eadd8a81-ad43-4929-8a17-ab43cceb1772 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:23.728287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-eadd8a81-ad43-4929-8a17-ab43cceb1772 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:23.729463 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-eadd8a81-ad43-4929-8a17-ab43cceb1772 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1281 microversion: 2.20 time: 0.072932 Aug 26 08:57:23.730032 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 326/663] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:23 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:24.253343 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8e74c683-6b1d-43fc-9e26-27e34db14dd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:24.254223 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8e74c683-6b1d-43fc-9e26-27e34db14dd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:24.261715 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8e74c683-6b1d-43fc-9e26-27e34db14dd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:24.262296 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8e74c683-6b1d-43fc-9e26-27e34db14dd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:24.262725 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8e74c683-6b1d-43fc-9e26-27e34db14dd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:24.263473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8e74c683-6b1d-43fc-9e26-27e34db14dd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:24.263911 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8e74c683-6b1d-43fc-9e26-27e34db14dd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:24.264331 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8e74c683-6b1d-43fc-9e26-27e34db14dd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:24.423661 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8e74c683-6b1d-43fc-9e26-27e34db14dd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:24.432796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8e74c683-6b1d-43fc-9e26-27e34db14dd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.184243 Aug 26 08:57:24.433402 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 338/664] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:24 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:24.752980 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-7befccf5-6618-40cf-9788-f4ebc93fab11 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:24.753745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-7befccf5-6618-40cf-9788-f4ebc93fab11 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:24.760640 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7befccf5-6618-40cf-9788-f4ebc93fab11 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:24.761127 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7befccf5-6618-40cf-9788-f4ebc93fab11 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:24.761559 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7befccf5-6618-40cf-9788-f4ebc93fab11 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:24.762304 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7befccf5-6618-40cf-9788-f4ebc93fab11 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:24.762757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7befccf5-6618-40cf-9788-f4ebc93fab11 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:24.763217 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7befccf5-6618-40cf-9788-f4ebc93fab11 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:24.831756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7befccf5-6618-40cf-9788-f4ebc93fab11 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:24.840490 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7befccf5-6618-40cf-9788-f4ebc93fab11 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:24.841929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7befccf5-6618-40cf-9788-f4ebc93fab11 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:24.843103 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-7befccf5-6618-40cf-9788-f4ebc93fab11 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1333 microversion: 2.20 time: 0.094550 Aug 26 08:57:24.843658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 327/665] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:24 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:25.454457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b7f2148a-32ea-439b-9faa-8270cab6670c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:25.455261 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b7f2148a-32ea-439b-9faa-8270cab6670c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:25.464017 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b7f2148a-32ea-439b-9faa-8270cab6670c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:25.464539 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b7f2148a-32ea-439b-9faa-8270cab6670c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:25.464979 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b7f2148a-32ea-439b-9faa-8270cab6670c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:25.465901 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b7f2148a-32ea-439b-9faa-8270cab6670c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:25.466365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b7f2148a-32ea-439b-9faa-8270cab6670c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:25.466788 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b7f2148a-32ea-439b-9faa-8270cab6670c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:25.691752 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b7f2148a-32ea-439b-9faa-8270cab6670c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:25.700334 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b7f2148a-32ea-439b-9faa-8270cab6670c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.249959 Aug 26 08:57:25.700921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 339/666] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:25 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:25.867001 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8f4b754a-0626-4075-8ea3-e6ad9b9ea9b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:25.867582 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8f4b754a-0626-4075-8ea3-e6ad9b9ea9b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:25.875510 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f4b754a-0626-4075-8ea3-e6ad9b9ea9b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:25.876101 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f4b754a-0626-4075-8ea3-e6ad9b9ea9b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:25.876482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f4b754a-0626-4075-8ea3-e6ad9b9ea9b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:25.877193 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f4b754a-0626-4075-8ea3-e6ad9b9ea9b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:25.877885 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f4b754a-0626-4075-8ea3-e6ad9b9ea9b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:25.878335 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f4b754a-0626-4075-8ea3-e6ad9b9ea9b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:25.948221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8f4b754a-0626-4075-8ea3-e6ad9b9ea9b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:25.957538 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8f4b754a-0626-4075-8ea3-e6ad9b9ea9b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:25.958972 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8f4b754a-0626-4075-8ea3-e6ad9b9ea9b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:25.960095 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8f4b754a-0626-4075-8ea3-e6ad9b9ea9b5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1339 microversion: 2.20 time: 0.098163 Aug 26 08:57:25.960660 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 328/667] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:25 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:26.724155 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-abbc5372-8c34-46c0-b130-09894988d39e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:26.725300 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-abbc5372-8c34-46c0-b130-09894988d39e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:26.732420 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-abbc5372-8c34-46c0-b130-09894988d39e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:26.732921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-abbc5372-8c34-46c0-b130-09894988d39e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:26.733473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-abbc5372-8c34-46c0-b130-09894988d39e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:26.734195 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-abbc5372-8c34-46c0-b130-09894988d39e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:26.734724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-abbc5372-8c34-46c0-b130-09894988d39e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:26.735171 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-abbc5372-8c34-46c0-b130-09894988d39e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:26.964047 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-abbc5372-8c34-46c0-b130-09894988d39e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:26.974339 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-abbc5372-8c34-46c0-b130-09894988d39e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.255404 Aug 26 08:57:26.975553 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 340/668] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:26 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:26.982634 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-da0800a3-4d57-420b-b0d3-5513ae934ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:26.983764 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-da0800a3-4d57-420b-b0d3-5513ae934ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:26.996241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-da0800a3-4d57-420b-b0d3-5513ae934ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:26.997093 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-da0800a3-4d57-420b-b0d3-5513ae934ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:26.997450 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-da0800a3-4d57-420b-b0d3-5513ae934ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:26.998964 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-da0800a3-4d57-420b-b0d3-5513ae934ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:26.999791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-da0800a3-4d57-420b-b0d3-5513ae934ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:27.000565 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-da0800a3-4d57-420b-b0d3-5513ae934ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:27.163967 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-91a92c19-be6d-4388-9a7a-79bb1025e285 req-7d91a247-b78e-4d84-ab17-2f3d2320e707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbfe1e03-de30-4198-9a4d-a96708dbb98b", "tag": "57b16be7-70f7-4545-b557-e106d767a915"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:27.177889 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-91a92c19-be6d-4388-9a7a-79bb1025e285 req-7d91a247-b78e-4d84-ab17-2f3d2320e707 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:27.178859 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-91a92c19-be6d-4388-9a7a-79bb1025e285 req-7d91a247-b78e-4d84-ab17-2f3d2320e707 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:27.179600 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-91a92c19-be6d-4388-9a7a-79bb1025e285 req-7d91a247-b78e-4d84-ab17-2f3d2320e707 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:27.185685 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:27.195482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-da0800a3-4d57-420b-b0d3-5513ae934ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:27.201675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-91a92c19-be6d-4388-9a7a-79bb1025e285 req-7d91a247-b78e-4d84-ab17-2f3d2320e707 service nova] Creating event network-changed:57b16be7-70f7-4545-b557-e106d767a915 for instance cbfe1e03-de30-4198-9a4d-a96708dbb98b on hv-cinder-85236 Aug 26 08:57:27.206321 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-da0800a3-4d57-420b-b0d3-5513ae934ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:27.207988 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-da0800a3-4d57-420b-b0d3-5513ae934ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:27.209666 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-da0800a3-4d57-420b-b0d3-5513ae934ceb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1406 microversion: 2.20 time: 0.231135 Aug 26 08:57:27.211558 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-91a92c19-be6d-4388-9a7a-79bb1025e285 req-7d91a247-b78e-4d84-ab17-2f3d2320e707 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140664 Aug 26 08:57:27.212738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 341/669] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:57:27.223282 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 329/670] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:26 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:28.001518 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-28e0b5ae-965d-4681-b03f-d4f1114133d6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:28.002229 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-28e0b5ae-965d-4681-b03f-d4f1114133d6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:28.010126 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-28e0b5ae-965d-4681-b03f-d4f1114133d6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:28.010617 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-28e0b5ae-965d-4681-b03f-d4f1114133d6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:28.011086 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-28e0b5ae-965d-4681-b03f-d4f1114133d6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:28.011809 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-28e0b5ae-965d-4681-b03f-d4f1114133d6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:28.012266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-28e0b5ae-965d-4681-b03f-d4f1114133d6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:28.012678 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-28e0b5ae-965d-4681-b03f-d4f1114133d6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:28.157081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-28e0b5ae-965d-4681-b03f-d4f1114133d6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:28.165652 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-28e0b5ae-965d-4681-b03f-d4f1114133d6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.168991 Aug 26 08:57:28.166256 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 342/671] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:27 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:28.234368 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a8aa7447-365b-4d28-87e3-e8a10f0d37c0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:28.235147 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a8aa7447-365b-4d28-87e3-e8a10f0d37c0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:28.242236 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a8aa7447-365b-4d28-87e3-e8a10f0d37c0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:28.242730 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a8aa7447-365b-4d28-87e3-e8a10f0d37c0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:28.243174 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a8aa7447-365b-4d28-87e3-e8a10f0d37c0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:28.243851 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a8aa7447-365b-4d28-87e3-e8a10f0d37c0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:28.244291 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a8aa7447-365b-4d28-87e3-e8a10f0d37c0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:28.244707 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a8aa7447-365b-4d28-87e3-e8a10f0d37c0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:28.391565 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a8aa7447-365b-4d28-87e3-e8a10f0d37c0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:28.400648 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a8aa7447-365b-4d28-87e3-e8a10f0d37c0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:28.402106 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a8aa7447-365b-4d28-87e3-e8a10f0d37c0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:28.403262 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a8aa7447-365b-4d28-87e3-e8a10f0d37c0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1406 microversion: 2.20 time: 0.173136 Aug 26 08:57:28.403829 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 330/672] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:28 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:29.188073 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ba603c1f-d5c9-4482-b47d-3dd0f94c165e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:29.188707 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ba603c1f-d5c9-4482-b47d-3dd0f94c165e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:29.195798 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba603c1f-d5c9-4482-b47d-3dd0f94c165e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:29.196283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba603c1f-d5c9-4482-b47d-3dd0f94c165e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:29.196718 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba603c1f-d5c9-4482-b47d-3dd0f94c165e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:29.197437 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba603c1f-d5c9-4482-b47d-3dd0f94c165e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:29.197886 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba603c1f-d5c9-4482-b47d-3dd0f94c165e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:29.198306 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba603c1f-d5c9-4482-b47d-3dd0f94c165e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:29.380847 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ba603c1f-d5c9-4482-b47d-3dd0f94c165e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:29.389497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ba603c1f-d5c9-4482-b47d-3dd0f94c165e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.205607 Aug 26 08:57:29.390086 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 343/673] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:29 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:29.426584 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-612936ec-33ab-4481-8534-f444d45d5e57 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:29.427226 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-612936ec-33ab-4481-8534-f444d45d5e57 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:29.434076 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-612936ec-33ab-4481-8534-f444d45d5e57 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:29.434566 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-612936ec-33ab-4481-8534-f444d45d5e57 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:29.435026 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-612936ec-33ab-4481-8534-f444d45d5e57 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:29.435733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-612936ec-33ab-4481-8534-f444d45d5e57 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:29.436183 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-612936ec-33ab-4481-8534-f444d45d5e57 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:29.436701 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-612936ec-33ab-4481-8534-f444d45d5e57 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:29.572537 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-612936ec-33ab-4481-8534-f444d45d5e57 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:29.581378 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-612936ec-33ab-4481-8534-f444d45d5e57 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:29.582784 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-612936ec-33ab-4481-8534-f444d45d5e57 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:29.584391 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-612936ec-33ab-4481-8534-f444d45d5e57 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1406 microversion: 2.20 time: 0.161564 Aug 26 08:57:29.584958 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 331/674] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:29 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:30.411893 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-11920d8d-efc3-4e38-88e9-f037c04974ff tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:30.412473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-11920d8d-efc3-4e38-88e9-f037c04974ff tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:30.419649 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-11920d8d-efc3-4e38-88e9-f037c04974ff tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:30.420179 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-11920d8d-efc3-4e38-88e9-f037c04974ff tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:30.420625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-11920d8d-efc3-4e38-88e9-f037c04974ff tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:30.421384 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-11920d8d-efc3-4e38-88e9-f037c04974ff tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:30.421837 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-11920d8d-efc3-4e38-88e9-f037c04974ff tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:30.422257 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-11920d8d-efc3-4e38-88e9-f037c04974ff tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:30.565263 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-11920d8d-efc3-4e38-88e9-f037c04974ff tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:30.574252 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-11920d8d-efc3-4e38-88e9-f037c04974ff tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.166256 Aug 26 08:57:30.574864 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 344/675] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:30 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:30.608028 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d351a3e1-63fb-48aa-9fd9-9c8db30b04d5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:30.608728 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d351a3e1-63fb-48aa-9fd9-9c8db30b04d5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:30.615808 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d351a3e1-63fb-48aa-9fd9-9c8db30b04d5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:30.616288 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d351a3e1-63fb-48aa-9fd9-9c8db30b04d5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:30.616714 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d351a3e1-63fb-48aa-9fd9-9c8db30b04d5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:30.617405 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d351a3e1-63fb-48aa-9fd9-9c8db30b04d5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:30.617849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d351a3e1-63fb-48aa-9fd9-9c8db30b04d5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:30.618496 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d351a3e1-63fb-48aa-9fd9-9c8db30b04d5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:30.774346 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d351a3e1-63fb-48aa-9fd9-9c8db30b04d5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:30.784008 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d351a3e1-63fb-48aa-9fd9-9c8db30b04d5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:30.785443 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d351a3e1-63fb-48aa-9fd9-9c8db30b04d5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:30.786605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d351a3e1-63fb-48aa-9fd9-9c8db30b04d5 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1406 microversion: 2.20 time: 0.182943 Aug 26 08:57:30.787217 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 332/676] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:30 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:31.598203 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8d9b4ad6-2075-4e06-bc9e-51d542db604b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:31.598966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8d9b4ad6-2075-4e06-bc9e-51d542db604b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:31.606052 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8d9b4ad6-2075-4e06-bc9e-51d542db604b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:31.606561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8d9b4ad6-2075-4e06-bc9e-51d542db604b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:31.607025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8d9b4ad6-2075-4e06-bc9e-51d542db604b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:31.607839 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8d9b4ad6-2075-4e06-bc9e-51d542db604b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:31.608303 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8d9b4ad6-2075-4e06-bc9e-51d542db604b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:31.608717 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8d9b4ad6-2075-4e06-bc9e-51d542db604b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:31.759647 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8d9b4ad6-2075-4e06-bc9e-51d542db604b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:31.769034 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8d9b4ad6-2075-4e06-bc9e-51d542db604b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.174872 Aug 26 08:57:31.769910 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 345/677] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:31 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:31.813873 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b779e79b-745c-4e04-806c-4a4bd3b796a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:31.814485 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b779e79b-745c-4e04-806c-4a4bd3b796a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:31.821815 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b779e79b-745c-4e04-806c-4a4bd3b796a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:31.822305 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b779e79b-745c-4e04-806c-4a4bd3b796a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:31.823524 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b779e79b-745c-4e04-806c-4a4bd3b796a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:31.824241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b779e79b-745c-4e04-806c-4a4bd3b796a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:31.824681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b779e79b-745c-4e04-806c-4a4bd3b796a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:31.825446 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b779e79b-745c-4e04-806c-4a4bd3b796a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:31.973731 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b779e79b-745c-4e04-806c-4a4bd3b796a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:31.982148 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b779e79b-745c-4e04-806c-4a4bd3b796a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:31.983896 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b779e79b-745c-4e04-806c-4a4bd3b796a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:31.985007 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b779e79b-745c-4e04-806c-4a4bd3b796a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1406 microversion: 2.20 time: 0.175544 Aug 26 08:57:31.985571 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 333/678] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:31 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:32.233458 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e7415ef7-1dc1-43b8-9856-aeaf4d93038b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:32.233883 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e7415ef7-1dc1-43b8-9856-aeaf4d93038b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:32.240806 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e7415ef7-1dc1-43b8-9856-aeaf4d93038b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:32.241289 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e7415ef7-1dc1-43b8-9856-aeaf4d93038b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:32.241717 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e7415ef7-1dc1-43b8-9856-aeaf4d93038b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:32.242407 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e7415ef7-1dc1-43b8-9856-aeaf4d93038b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:32.242874 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e7415ef7-1dc1-43b8-9856-aeaf4d93038b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:32.243316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e7415ef7-1dc1-43b8-9856-aeaf4d93038b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:32.268154 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e7415ef7-1dc1-43b8-9856-aeaf4d93038b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2/ips" status: 200 len: 149 microversion: 2.1 time: 0.038944 Aug 26 08:57:32.268770 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 346/679] 10.222.0.71 () {58 vars in 1248 bytes} [Fri Aug 26 08:57:32 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:57:32.281018 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-dbf14c3e-4654-4dfb-99af-b9fd77c97d7e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8165260-2d93-4a05-907f-a9bfded863b7"}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:32.283518 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-dbf14c3e-4654-4dfb-99af-b9fd77c97d7e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:32.290014 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dbf14c3e-4654-4dfb-99af-b9fd77c97d7e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:32.290486 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dbf14c3e-4654-4dfb-99af-b9fd77c97d7e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:32.290963 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dbf14c3e-4654-4dfb-99af-b9fd77c97d7e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:32.291654 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dbf14c3e-4654-4dfb-99af-b9fd77c97d7e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:32.292102 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dbf14c3e-4654-4dfb-99af-b9fd77c97d7e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:32.292508 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dbf14c3e-4654-4dfb-99af-b9fd77c97d7e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:32.380552 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-dbf14c3e-4654-4dfb-99af-b9fd77c97d7e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] HTTP exception thrown: Invalid volume: volume a8165260-2d93-4a05-907f-a9bfded863b7 is already attached to instances: a2e441bb-c7f1-4f57-a936-ae82ddea56c5 Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-dbf14c3e-4654-4dfb-99af-b9fd77c97d7e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Request method failure captured: Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: POST /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2/os-volume_attachments HTTP/1.1 Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 74 Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIoEmQS0ltyE06Nj4PuDW7tRWlQx7ddVxbpmBorGEN4vH-Qi6t2BygustSi6IBEkokqI2I_SWwZYOmA6m8lhi8TWDRbttWpAHlEIqCkO0TFDD5IrIzdgnbzjwj6reGrNhrygHKk-ixwJbs_wRUzJRPtDT1VapHI831oEiCSS5Q537B4 Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 08:57:32.382283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 08:57:32.383806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f87dce6d7f01455fb8c3cfe128c20e72", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:57:32.383806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:57:32.383806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 08:57:32.383806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:57:32.383806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 08:57:32.383806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 08:57:32.383806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 08:57:32.383806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 406be06d6adf40bbb48d9baf12022988 Aug 26 08:57:32.383806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 08:57:32.383806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Aug 26 08:57:32.383806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {"volumeAttachment": {"volumeId": "a8165260-2d93-4a05-907f-a9bfded863b7"}} Aug 26 08:57:32.383806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Invalid volume: volume a8165260-2d93-4a05-907f-a9bfded863b7 is already attached to instances: a2e441bb-c7f1-4f57-a936-ae82ddea56c5 Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'server_id': 'b220de56-45f9-4761-8d48-e80cbc874ca2', 'body': {'volumeAttachment': {'volumeId': 'a8165260-2d93-4a05-907f-a9bfded863b7'}}} Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a8165260-2d93-4a05-907f-a9bfded863b7 is already attached to instances: a2e441bb-c7f1-4f57-a936-ae82ddea56c5 Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:32.384928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a8165260-2d93-4a05-907f-a9bfded863b7 is already attached to instances: a2e441bb-c7f1-4f57-a936-ae82ddea56c5 Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:32.386316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:57:32.387745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:57:32.387745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:57:32.387745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:57:32.387745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a8165260-2d93-4a05-907f-a9bfded863b7 is already attached to instances: a2e441bb-c7f1-4f57-a936-ae82ddea56c5 Aug 26 08:57:32.387745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:32.387745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-dbf14c3e-4654-4dfb-99af-b9fd77c97d7e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Returning 400 to user: Invalid volume: volume a8165260-2d93-4a05-907f-a9bfded863b7 is already attached to instances: a2e441bb-c7f1-4f57-a936-ae82ddea56c5 {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:57:32.387745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-dbf14c3e-4654-4dfb-99af-b9fd77c97d7e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "POST /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107082 Aug 26 08:57:32.387745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 334/680] 10.222.0.71 () {60 vars in 1323 bytes} [Fri Aug 26 08:57:32 2022] POST /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 08:57:32.393416 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-eb98849b-edc9-409d-9db0-73eacf13239f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:32.393837 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-eb98849b-edc9-409d-9db0-73eacf13239f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:32.400091 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eb98849b-edc9-409d-9db0-73eacf13239f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:32.400568 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eb98849b-edc9-409d-9db0-73eacf13239f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:32.401112 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eb98849b-edc9-409d-9db0-73eacf13239f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:32.401670 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eb98849b-edc9-409d-9db0-73eacf13239f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:32.402112 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eb98849b-edc9-409d-9db0-73eacf13239f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:32.402521 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eb98849b-edc9-409d-9db0-73eacf13239f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:32.428200 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-eb98849b-edc9-409d-9db0-73eacf13239f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 08:57:32.512497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-eb98849b-edc9-409d-9db0-73eacf13239f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 204 len: 0 microversion: 2.1 time: 0.122414 Aug 26 08:57:32.513440 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 347/681] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 08:57:32 2022] DELETE /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:57:32.522631 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ff154e4f-d16e-4049-bdcb-56721015ea3d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:32.523469 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ff154e4f-d16e-4049-bdcb-56721015ea3d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:32.531623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ff154e4f-d16e-4049-bdcb-56721015ea3d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:32.532106 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ff154e4f-d16e-4049-bdcb-56721015ea3d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:32.532593 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ff154e4f-d16e-4049-bdcb-56721015ea3d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:32.533372 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ff154e4f-d16e-4049-bdcb-56721015ea3d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:32.533825 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ff154e4f-d16e-4049-bdcb-56721015ea3d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:32.534246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ff154e4f-d16e-4049-bdcb-56721015ea3d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:32.671332 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ff154e4f-d16e-4049-bdcb-56721015ea3d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:32.679673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ff154e4f-d16e-4049-bdcb-56721015ea3d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1681 microversion: 2.1 time: 0.161422 Aug 26 08:57:32.680237 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 335/682] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:32 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:32.792323 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f95267be-3212-4a67-802e-1778b02b46da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:32.793013 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f95267be-3212-4a67-802e-1778b02b46da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:32.800127 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f95267be-3212-4a67-802e-1778b02b46da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:32.800616 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f95267be-3212-4a67-802e-1778b02b46da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:32.801048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f95267be-3212-4a67-802e-1778b02b46da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:32.802042 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f95267be-3212-4a67-802e-1778b02b46da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:32.802187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f95267be-3212-4a67-802e-1778b02b46da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:32.802602 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f95267be-3212-4a67-802e-1778b02b46da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:32.939875 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f95267be-3212-4a67-802e-1778b02b46da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:32.954357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f95267be-3212-4a67-802e-1778b02b46da tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.166226 Aug 26 08:57:32.955031 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 348/683] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:32 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:33.008490 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-bcc65465-f5a4-4d31-9faf-1c2eb9e5a48c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:33.009097 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-bcc65465-f5a4-4d31-9faf-1c2eb9e5a48c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:33.016516 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bcc65465-f5a4-4d31-9faf-1c2eb9e5a48c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:33.016976 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bcc65465-f5a4-4d31-9faf-1c2eb9e5a48c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:33.017418 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bcc65465-f5a4-4d31-9faf-1c2eb9e5a48c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:33.018123 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bcc65465-f5a4-4d31-9faf-1c2eb9e5a48c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:33.018699 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bcc65465-f5a4-4d31-9faf-1c2eb9e5a48c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:33.019110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bcc65465-f5a4-4d31-9faf-1c2eb9e5a48c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:33.166840 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bcc65465-f5a4-4d31-9faf-1c2eb9e5a48c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:33.181709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bcc65465-f5a4-4d31-9faf-1c2eb9e5a48c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:33.184473 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bcc65465-f5a4-4d31-9faf-1c2eb9e5a48c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:33.186591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-bcc65465-f5a4-4d31-9faf-1c2eb9e5a48c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1406 microversion: 2.20 time: 0.181870 Aug 26 08:57:33.187610 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 336/684] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:33 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:33.370643 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-7270fc80-3212-42a3-957d-6005c179e338 req-e5ff4ea2-373c-44f5-aa69-ca208539ef8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbfe1e03-de30-4198-9a4d-a96708dbb98b", "name": "network-vif-plugged", "status": "completed", "tag": "57b16be7-70f7-4545-b557-e106d767a915"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:33.381607 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-7270fc80-3212-42a3-957d-6005c179e338 req-e5ff4ea2-373c-44f5-aa69-ca208539ef8f service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:33.382095 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-7270fc80-3212-42a3-957d-6005c179e338 req-e5ff4ea2-373c-44f5-aa69-ca208539ef8f service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:33.382625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-7270fc80-3212-42a3-957d-6005c179e338 req-e5ff4ea2-373c-44f5-aa69-ca208539ef8f service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:33.395092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-7270fc80-3212-42a3-957d-6005c179e338 req-e5ff4ea2-373c-44f5-aa69-ca208539ef8f service nova] Creating event network-vif-plugged:57b16be7-70f7-4545-b557-e106d767a915 for instance cbfe1e03-de30-4198-9a4d-a96708dbb98b on hv-cinder-85236 Aug 26 08:57:33.400332 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-7270fc80-3212-42a3-957d-6005c179e338 req-e5ff4ea2-373c-44f5-aa69-ca208539ef8f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107714 Aug 26 08:57:33.400959 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 349/685] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:57:33.701410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d5c39dde-7c7b-4333-89e9-4952eb7c7574 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:33.702024 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d5c39dde-7c7b-4333-89e9-4952eb7c7574 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:33.708774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d5c39dde-7c7b-4333-89e9-4952eb7c7574 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:33.709262 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d5c39dde-7c7b-4333-89e9-4952eb7c7574 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:33.709680 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d5c39dde-7c7b-4333-89e9-4952eb7c7574 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:33.710404 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d5c39dde-7c7b-4333-89e9-4952eb7c7574 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:33.710836 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d5c39dde-7c7b-4333-89e9-4952eb7c7574 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:33.711290 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d5c39dde-7c7b-4333-89e9-4952eb7c7574 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:33.726464 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:33.856373 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d5c39dde-7c7b-4333-89e9-4952eb7c7574 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:33.865000 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d5c39dde-7c7b-4333-89e9-4952eb7c7574 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1681 microversion: 2.1 time: 0.167448 Aug 26 08:57:33.865592 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 337/686] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:33 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:33.974062 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:33.975278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=10 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:33.979887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6b35a0d5-37cd-4f01-bb31-9d2b5d99637d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:33.980589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6b35a0d5-37cd-4f01-bb31-9d2b5d99637d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:33.987846 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b35a0d5-37cd-4f01-bb31-9d2b5d99637d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:33.988331 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b35a0d5-37cd-4f01-bb31-9d2b5d99637d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:33.988762 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b35a0d5-37cd-4f01-bb31-9d2b5d99637d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:33.989460 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b35a0d5-37cd-4f01-bb31-9d2b5d99637d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:33.989915 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b35a0d5-37cd-4f01-bb31-9d2b5d99637d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:33.990327 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b35a0d5-37cd-4f01-bb31-9d2b5d99637d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:34.127788 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6b35a0d5-37cd-4f01-bb31-9d2b5d99637d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:34.136595 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6b35a0d5-37cd-4f01-bb31-9d2b5d99637d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.163755 Aug 26 08:57:34.137205 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 350/687] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:33 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:34.211249 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a6be75d5-ac9c-4888-aafb-9bbf62e7888f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:34.211784 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a6be75d5-ac9c-4888-aafb-9bbf62e7888f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:34.218976 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a6be75d5-ac9c-4888-aafb-9bbf62e7888f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:34.219489 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a6be75d5-ac9c-4888-aafb-9bbf62e7888f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:34.219916 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a6be75d5-ac9c-4888-aafb-9bbf62e7888f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:34.220720 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a6be75d5-ac9c-4888-aafb-9bbf62e7888f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:34.221272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a6be75d5-ac9c-4888-aafb-9bbf62e7888f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:34.221654 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a6be75d5-ac9c-4888-aafb-9bbf62e7888f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:34.362490 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a6be75d5-ac9c-4888-aafb-9bbf62e7888f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:34.371295 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a6be75d5-ac9c-4888-aafb-9bbf62e7888f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:34.372758 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a6be75d5-ac9c-4888-aafb-9bbf62e7888f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:34.374837 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a6be75d5-ac9c-4888-aafb-9bbf62e7888f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1406 microversion: 2.20 time: 0.167599 Aug 26 08:57:34.374837 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 338/688] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:34 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:34.888298 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8eafe03e-efcd-4319-96aa-b3b36d018239 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:34.888933 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8eafe03e-efcd-4319-96aa-b3b36d018239 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:34.897157 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8eafe03e-efcd-4319-96aa-b3b36d018239 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:34.897674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8eafe03e-efcd-4319-96aa-b3b36d018239 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:34.898106 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8eafe03e-efcd-4319-96aa-b3b36d018239 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:34.898779 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8eafe03e-efcd-4319-96aa-b3b36d018239 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:34.899268 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8eafe03e-efcd-4319-96aa-b3b36d018239 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:34.899663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8eafe03e-efcd-4319-96aa-b3b36d018239 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:35.095838 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8eafe03e-efcd-4319-96aa-b3b36d018239 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:35.103953 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8eafe03e-efcd-4319-96aa-b3b36d018239 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1681 microversion: 2.1 time: 0.219923 Aug 26 08:57:35.104545 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 351/689] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:34 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:35.158227 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-da682a57-cdae-427e-ad78-9815d52fb989 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:35.158725 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-da682a57-cdae-427e-ad78-9815d52fb989 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:35.165166 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-da682a57-cdae-427e-ad78-9815d52fb989 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:35.165644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-da682a57-cdae-427e-ad78-9815d52fb989 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:35.166039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-da682a57-cdae-427e-ad78-9815d52fb989 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:35.167000 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-da682a57-cdae-427e-ad78-9815d52fb989 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:35.167458 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-da682a57-cdae-427e-ad78-9815d52fb989 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:35.167865 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-da682a57-cdae-427e-ad78-9815d52fb989 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:35.319886 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-da682a57-cdae-427e-ad78-9815d52fb989 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:35.329322 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-da682a57-cdae-427e-ad78-9815d52fb989 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.175316 Aug 26 08:57:35.329984 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 339/690] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:35 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:35.397131 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-36161905-2db2-4481-a45b-ef9134a1e938 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:35.397737 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-36161905-2db2-4481-a45b-ef9134a1e938 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:35.399665 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:35.405375 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-36161905-2db2-4481-a45b-ef9134a1e938 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:35.405926 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-36161905-2db2-4481-a45b-ef9134a1e938 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:35.406364 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-36161905-2db2-4481-a45b-ef9134a1e938 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:35.407106 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-36161905-2db2-4481-a45b-ef9134a1e938 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:35.407562 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-36161905-2db2-4481-a45b-ef9134a1e938 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:35.407983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-36161905-2db2-4481-a45b-ef9134a1e938 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:35.543969 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-36161905-2db2-4481-a45b-ef9134a1e938 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:35.553271 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-36161905-2db2-4481-a45b-ef9134a1e938 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:35.554714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-36161905-2db2-4481-a45b-ef9134a1e938 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:35.556158 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-36161905-2db2-4481-a45b-ef9134a1e938 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1406 microversion: 2.20 time: 0.162775 Aug 26 08:57:35.556709 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 352/691] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:35 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:36.127786 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9df428fb-c580-4661-be6d-0127137b301e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:36.128414 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9df428fb-c580-4661-be6d-0127137b301e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:36.134795 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9df428fb-c580-4661-be6d-0127137b301e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:36.135374 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9df428fb-c580-4661-be6d-0127137b301e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:36.135805 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9df428fb-c580-4661-be6d-0127137b301e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:36.136501 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9df428fb-c580-4661-be6d-0127137b301e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:36.136950 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9df428fb-c580-4661-be6d-0127137b301e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:36.137407 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9df428fb-c580-4661-be6d-0127137b301e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:36.276999 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9df428fb-c580-4661-be6d-0127137b301e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:36.285231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9df428fb-c580-4661-be6d-0127137b301e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1681 microversion: 2.1 time: 0.161874 Aug 26 08:57:36.285821 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 340/692] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:36 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:36.351779 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-313d7f48-6d4c-4c10-8681-528df022feb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:36.352380 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-313d7f48-6d4c-4c10-8681-528df022feb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:36.360091 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-313d7f48-6d4c-4c10-8681-528df022feb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:36.360585 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-313d7f48-6d4c-4c10-8681-528df022feb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:36.361015 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-313d7f48-6d4c-4c10-8681-528df022feb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:36.361738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-313d7f48-6d4c-4c10-8681-528df022feb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:36.362183 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-313d7f48-6d4c-4c10-8681-528df022feb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:36.362606 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-313d7f48-6d4c-4c10-8681-528df022feb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:36.507336 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-313d7f48-6d4c-4c10-8681-528df022feb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:36.519847 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-313d7f48-6d4c-4c10-8681-528df022feb1 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.172045 Aug 26 08:57:36.521017 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 353/693] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:36 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:36.580883 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-38b369c8-805a-4938-9077-6ee796e9ba19 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:36.581659 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-38b369c8-805a-4938-9077-6ee796e9ba19 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:36.587931 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-38b369c8-805a-4938-9077-6ee796e9ba19 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:36.588415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-38b369c8-805a-4938-9077-6ee796e9ba19 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:36.588971 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-38b369c8-805a-4938-9077-6ee796e9ba19 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:36.589787 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-38b369c8-805a-4938-9077-6ee796e9ba19 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:36.590463 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-38b369c8-805a-4938-9077-6ee796e9ba19 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:36.591166 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-38b369c8-805a-4938-9077-6ee796e9ba19 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:36.614599 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=100 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:36.839729 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-38b369c8-805a-4938-9077-6ee796e9ba19 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:36.848687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-38b369c8-805a-4938-9077-6ee796e9ba19 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:36.850132 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-38b369c8-805a-4938-9077-6ee796e9ba19 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:36.851330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-38b369c8-805a-4938-9077-6ee796e9ba19 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1406 microversion: 2.20 time: 0.275139 Aug 26 08:57:36.855984 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 341/694] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:36 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:37.307533 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c03f89a9-e4e0-4674-8e44-43ef0ff476e9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:37.308131 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c03f89a9-e4e0-4674-8e44-43ef0ff476e9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:37.314627 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c03f89a9-e4e0-4674-8e44-43ef0ff476e9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:37.315243 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c03f89a9-e4e0-4674-8e44-43ef0ff476e9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:37.315671 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c03f89a9-e4e0-4674-8e44-43ef0ff476e9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:37.316389 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c03f89a9-e4e0-4674-8e44-43ef0ff476e9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:37.317603 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c03f89a9-e4e0-4674-8e44-43ef0ff476e9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:37.318143 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c03f89a9-e4e0-4674-8e44-43ef0ff476e9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:37.396715 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c03f89a9-e4e0-4674-8e44-43ef0ff476e9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:37.404829 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c03f89a9-e4e0-4674-8e44-43ef0ff476e9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1613 microversion: 2.1 time: 0.101096 Aug 26 08:57:37.405451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 354/695] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:37 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1613 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:37.549914 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8c477657-8793-4189-948f-a22d570189c3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:37.550986 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8c477657-8793-4189-948f-a22d570189c3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:37.563773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c477657-8793-4189-948f-a22d570189c3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:37.564674 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c477657-8793-4189-948f-a22d570189c3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:37.565496 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c477657-8793-4189-948f-a22d570189c3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:37.566667 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c477657-8793-4189-948f-a22d570189c3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:37.567163 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c477657-8793-4189-948f-a22d570189c3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:37.567592 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c477657-8793-4189-948f-a22d570189c3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:37.884610 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1670093c-eef9-4ed6-a273-3030775c6528 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:37.885666 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1670093c-eef9-4ed6-a273-3030775c6528 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:37.890793 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8c477657-8793-4189-948f-a22d570189c3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:37.897124 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1670093c-eef9-4ed6-a273-3030775c6528 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:37.897739 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1670093c-eef9-4ed6-a273-3030775c6528 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:37.898425 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1670093c-eef9-4ed6-a273-3030775c6528 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:37.899281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1670093c-eef9-4ed6-a273-3030775c6528 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:37.899856 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1670093c-eef9-4ed6-a273-3030775c6528 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:37.900383 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1670093c-eef9-4ed6-a273-3030775c6528 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:37.908660 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8c477657-8793-4189-948f-a22d570189c3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.365768 Aug 26 08:57:37.915542 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 342/696] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:37 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:38.064017 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1670093c-eef9-4ed6-a273-3030775c6528 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:38.074174 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1670093c-eef9-4ed6-a273-3030775c6528 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:38.075528 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1670093c-eef9-4ed6-a273-3030775c6528 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:38.076763 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1670093c-eef9-4ed6-a273-3030775c6528 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1406 microversion: 2.20 time: 0.199193 Aug 26 08:57:38.078931 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-3386e1e8-1bdb-48ad-a22f-ed134fc9fc59 req-7e7c0f99-bc90-438b-b5f7-eea38ac9c88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b220de56-45f9-4761-8d48-e80cbc874ca2", "name": "network-vif-deleted", "tag": "22521262-299d-4e4d-9ba8-55935d2c7ebf"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:38.079148 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 355/697] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:37 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:57:38.088460 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-3386e1e8-1bdb-48ad-a22f-ed134fc9fc59 req-7e7c0f99-bc90-438b-b5f7-eea38ac9c88b service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:38.089046 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-3386e1e8-1bdb-48ad-a22f-ed134fc9fc59 req-7e7c0f99-bc90-438b-b5f7-eea38ac9c88b service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:38.089723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-3386e1e8-1bdb-48ad-a22f-ed134fc9fc59 req-7e7c0f99-bc90-438b-b5f7-eea38ac9c88b service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:38.102291 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-3386e1e8-1bdb-48ad-a22f-ed134fc9fc59 req-7e7c0f99-bc90-438b-b5f7-eea38ac9c88b service nova] Creating event network-vif-deleted:22521262-299d-4e4d-9ba8-55935d2c7ebf for instance b220de56-45f9-4761-8d48-e80cbc874ca2 on hv-cinder-85236 Aug 26 08:57:38.109075 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-3386e1e8-1bdb-48ad-a22f-ed134fc9fc59 req-7e7c0f99-bc90-438b-b5f7-eea38ac9c88b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102067 Aug 26 08:57:38.109075 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 343/698] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:57:38.428193 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6091fc97-8e17-489d-b864-3771a2ddff43 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:38.429498 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6091fc97-8e17-489d-b864-3771a2ddff43 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:38.440379 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6091fc97-8e17-489d-b864-3771a2ddff43 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:38.441352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6091fc97-8e17-489d-b864-3771a2ddff43 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:38.442115 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6091fc97-8e17-489d-b864-3771a2ddff43 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:38.443377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6091fc97-8e17-489d-b864-3771a2ddff43 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:38.444234 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6091fc97-8e17-489d-b864-3771a2ddff43 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:38.444976 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6091fc97-8e17-489d-b864-3771a2ddff43 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:38.545633 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6091fc97-8e17-489d-b864-3771a2ddff43 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:38.554512 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6091fc97-8e17-489d-b864-3771a2ddff43 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1326 microversion: 2.1 time: 0.130725 Aug 26 08:57:38.555125 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 356/699] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:38 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1326 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:38.935882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d671b0a9-530a-4141-b35f-0b6cd582d41e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:38.936766 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d671b0a9-530a-4141-b35f-0b6cd582d41e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:38.938712 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:38.944763 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d671b0a9-530a-4141-b35f-0b6cd582d41e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:38.945329 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d671b0a9-530a-4141-b35f-0b6cd582d41e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:38.945768 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d671b0a9-530a-4141-b35f-0b6cd582d41e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:38.946481 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d671b0a9-530a-4141-b35f-0b6cd582d41e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:38.946955 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d671b0a9-530a-4141-b35f-0b6cd582d41e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:38.947388 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d671b0a9-530a-4141-b35f-0b6cd582d41e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:39.097554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d671b0a9-530a-4141-b35f-0b6cd582d41e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:39.100956 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-55ea0903-3324-473b-ac4d-adf2a41d3ac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:39.102126 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-55ea0903-3324-473b-ac4d-adf2a41d3ac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:39.106879 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d671b0a9-530a-4141-b35f-0b6cd582d41e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1736 microversion: 2.1 time: 0.175798 Aug 26 08:57:39.107842 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 344/700] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:38 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:57:39.109673 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-55ea0903-3324-473b-ac4d-adf2a41d3ac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:39.110239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-55ea0903-3324-473b-ac4d-adf2a41d3ac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:39.110736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-55ea0903-3324-473b-ac4d-adf2a41d3ac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:39.111507 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-55ea0903-3324-473b-ac4d-adf2a41d3ac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:39.112179 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-55ea0903-3324-473b-ac4d-adf2a41d3ac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:39.112786 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-55ea0903-3324-473b-ac4d-adf2a41d3ac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:39.264094 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-55ea0903-3324-473b-ac4d-adf2a41d3ac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:39.271000 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:39.283783 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-55ea0903-3324-473b-ac4d-adf2a41d3ac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:39.286413 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-55ea0903-3324-473b-ac4d-adf2a41d3ac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:39.288476 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-55ea0903-3324-473b-ac4d-adf2a41d3ac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1597 microversion: 2.20 time: 0.192035 Aug 26 08:57:39.293854 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 357/701] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:57:39 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1597 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:57:39.329298 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a157b192-3d9e-45dc-9511-b45170b2150b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:39.329898 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a157b192-3d9e-45dc-9511-b45170b2150b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:39.344183 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a157b192-3d9e-45dc-9511-b45170b2150b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:39.345122 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a157b192-3d9e-45dc-9511-b45170b2150b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:39.346091 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a157b192-3d9e-45dc-9511-b45170b2150b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:39.347783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a157b192-3d9e-45dc-9511-b45170b2150b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:39.350827 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a157b192-3d9e-45dc-9511-b45170b2150b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:39.351717 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a157b192-3d9e-45dc-9511-b45170b2150b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:39.457195 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a157b192-3d9e-45dc-9511-b45170b2150b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.131604 Aug 26 08:57:39.458206 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 345/702] 10.222.0.71 () {60 vars in 1316 bytes} [Fri Aug 26 08:57:39 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 08:57:39.579218 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-19148e6f-b752-4702-ae8b-7921b384d185 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:39.580398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-19148e6f-b752-4702-ae8b-7921b384d185 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:39.593717 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19148e6f-b752-4702-ae8b-7921b384d185 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:39.594555 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19148e6f-b752-4702-ae8b-7921b384d185 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:39.595379 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19148e6f-b752-4702-ae8b-7921b384d185 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:39.596335 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19148e6f-b752-4702-ae8b-7921b384d185 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:39.597100 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19148e6f-b752-4702-ae8b-7921b384d185 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:39.597841 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19148e6f-b752-4702-ae8b-7921b384d185 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:39.649394 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c8d4ce7d-7b3c-49f8-8c9c-45e2106a1056 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:39.653105 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c8d4ce7d-7b3c-49f8-8c9c-45e2106a1056 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:39.662735 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19148e6f-b752-4702-ae8b-7921b384d185 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:39.662991 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c8d4ce7d-7b3c-49f8-8c9c-45e2106a1056 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:39.663537 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c8d4ce7d-7b3c-49f8-8c9c-45e2106a1056 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:39.663785 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19148e6f-b752-4702-ae8b-7921b384d185 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:39.664252 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-19148e6f-b752-4702-ae8b-7921b384d185 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:39.665147 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c8d4ce7d-7b3c-49f8-8c9c-45e2106a1056 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:39.665295 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-19148e6f-b752-4702-ae8b-7921b384d185 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'fault' on Instance uuid b220de56-45f9-4761-8d48-e80cbc874ca2 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:57:39.665825 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c8d4ce7d-7b3c-49f8-8c9c-45e2106a1056 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:39.666534 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c8d4ce7d-7b3c-49f8-8c9c-45e2106a1056 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:39.667224 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c8d4ce7d-7b3c-49f8-8c9c-45e2106a1056 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:39.736903 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-19148e6f-b752-4702-ae8b-7921b384d185 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:39.745604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-19148e6f-b752-4702-ae8b-7921b384d185 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1331 microversion: 2.1 time: 0.173637 Aug 26 08:57:39.746453 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 358/703] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:39 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1331 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:39.763305 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c8d4ce7d-7b3c-49f8-8c9c-45e2106a1056 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "POST /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/action" status: 202 len: 0 microversion: 2.1 time: 0.120396 Aug 26 08:57:39.767413 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 346/704] 10.222.0.71 () {60 vars in 1278 bytes} [Fri Aug 26 08:57:39 2022] POST /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:57:39.772870 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ad551914-1938-4dd9-8ad7-724946b0aca4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:39.773525 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ad551914-1938-4dd9-8ad7-724946b0aca4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:39.779787 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ad551914-1938-4dd9-8ad7-724946b0aca4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:39.780357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ad551914-1938-4dd9-8ad7-724946b0aca4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:39.780818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ad551914-1938-4dd9-8ad7-724946b0aca4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:39.781558 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ad551914-1938-4dd9-8ad7-724946b0aca4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:39.782014 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ad551914-1938-4dd9-8ad7-724946b0aca4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:39.782436 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ad551914-1938-4dd9-8ad7-724946b0aca4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:40.077679 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ad551914-1938-4dd9-8ad7-724946b0aca4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:40.090026 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ad551914-1938-4dd9-8ad7-724946b0aca4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1753 microversion: 2.1 time: 0.320963 Aug 26 08:57:40.091762 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 359/705] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:39 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1753 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:40.131193 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0e216e2a-98e5-4183-8b7e-c057d431045f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:40.132038 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-0e216e2a-98e5-4183-8b7e-c057d431045f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:40.141180 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0e216e2a-98e5-4183-8b7e-c057d431045f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:40.141932 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0e216e2a-98e5-4183-8b7e-c057d431045f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:40.142758 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0e216e2a-98e5-4183-8b7e-c057d431045f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:40.143844 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0e216e2a-98e5-4183-8b7e-c057d431045f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:40.144683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0e216e2a-98e5-4183-8b7e-c057d431045f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:40.145375 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0e216e2a-98e5-4183-8b7e-c057d431045f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:40.423389 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0e216e2a-98e5-4183-8b7e-c057d431045f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:40.432419 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-0e216e2a-98e5-4183-8b7e-c057d431045f tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1716 microversion: 2.1 time: 0.305482 Aug 26 08:57:40.433063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 347/706] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:40 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1716 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:40.502607 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c6f85b3f-a92a-4531-b63d-6f35f1f11c08 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:40.503426 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c6f85b3f-a92a-4531-b63d-6f35f1f11c08 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:40.511435 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c6f85b3f-a92a-4531-b63d-6f35f1f11c08 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:40.512203 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c6f85b3f-a92a-4531-b63d-6f35f1f11c08 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:40.512794 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c6f85b3f-a92a-4531-b63d-6f35f1f11c08 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:40.513681 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c6f85b3f-a92a-4531-b63d-6f35f1f11c08 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:40.514301 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c6f85b3f-a92a-4531-b63d-6f35f1f11c08 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:40.514753 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c6f85b3f-a92a-4531-b63d-6f35f1f11c08 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:40.626464 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-c6f85b3f-a92a-4531-b63d-6f35f1f11c08 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] HTTP exception thrown: Cannot 'detach_volume' instance 1704235c-9819-4980-9ee0-b46ecd91de2e while it is in vm_state rescued Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c6f85b3f-a92a-4531-b63d-6f35f1f11c08 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Request method failure captured: Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: DELETE /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-volume_attachments/e182deb0-7571-4634-bddb-118bf51b22b3 HTTP/1.1 Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCImvYbics5fHnhYQUsY3Ln3prZ2azA4IHqkelF0XmV2pym4A3ArmldC0YsDyJoDTxdWgxVyBe3sw83XWKq4Qh_K3R2hFZXymYlcdOpI_XFJZIDGJ3P5USGxZ4W6-2jz0estC8rSJF0fF_u2VYoJyDfEZYq6CSipyAHm6hPNY2gWr8Ss Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 01d9fa7bc7124476aa295e69b120becd Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 08:57:40.628266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 08:57:40.629818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_01d9fa7bc7124476aa295e69b120becd", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:57:40.629818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:57:40.629818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 01d9fa7bc7124476aa295e69b120becd Aug 26 08:57:40.629818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:57:40.629818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-ServerRescueNegativeTestJSON-1223166117-project Aug 26 08:57:40.629818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 08:57:40.629818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 08:57:40.629818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 3aced0ed17b946f9961d87a1d4446c37 Aug 26 08:57:40.629818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1223166117-project Aug 26 08:57:40.629818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 08:57:40.629818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Cannot 'detach_volume' instance 1704235c-9819-4980-9ee0-b46ecd91de2e while it is in vm_state rescued Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'server_id': '1704235c-9819-4980-9ee0-b46ecd91de2e', 'id': 'e182deb0-7571-4634-bddb-118bf51b22b3'} Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1704235c-9819-4980-9ee0-b46ecd91de2e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:57:40.630641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1704235c-9819-4980-9ee0-b46ecd91de2e while it is in vm_state rescued Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1704235c-9819-4980-9ee0-b46ecd91de2e while it is in vm_state rescued Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:40.632071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c6f85b3f-a92a-4531-b63d-6f35f1f11c08 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Returning 409 to user: Cannot 'detach_volume' instance 1704235c-9819-4980-9ee0-b46ecd91de2e while it is in vm_state rescued {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:57:40.633051 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c6f85b3f-a92a-4531-b63d-6f35f1f11c08 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "DELETE /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-volume_attachments/e182deb0-7571-4634-bddb-118bf51b22b3" status: 409 len: 152 microversion: 2.1 time: 0.131825 Aug 26 08:57:40.633051 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 360/707] 10.222.0.71 () {58 vars in 1416 bytes} [Fri Aug 26 08:57:40 2022] DELETE /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-volume_attachments/e182deb0-7571-4634-bddb-118bf51b22b3 => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 26 08:57:40.644004 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c50dcd68-a933-4989-b787-b4926dde936d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:40.644910 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c50dcd68-a933-4989-b787-b4926dde936d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:40.654859 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c50dcd68-a933-4989-b787-b4926dde936d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:40.655884 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c50dcd68-a933-4989-b787-b4926dde936d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:40.656638 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c50dcd68-a933-4989-b787-b4926dde936d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:40.657938 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c50dcd68-a933-4989-b787-b4926dde936d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:40.658765 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c50dcd68-a933-4989-b787-b4926dde936d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:40.659869 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c50dcd68-a933-4989-b787-b4926dde936d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:40.746299 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c50dcd68-a933-4989-b787-b4926dde936d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "POST /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/action" status: 202 len: 0 microversion: 2.1 time: 0.108899 Aug 26 08:57:40.751280 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 348/708] 10.222.0.71 () {60 vars in 1278 bytes} [Fri Aug 26 08:57:40 2022] POST /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:57:40.760839 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-eeee0156-5742-4ba7-93a5-57a8de9db458 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:40.762079 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-eeee0156-5742-4ba7-93a5-57a8de9db458 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:40.771026 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-880950b2-c39f-43c6-968e-5b68b5a2288a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:40.771878 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-880950b2-c39f-43c6-968e-5b68b5a2288a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:40.774864 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eeee0156-5742-4ba7-93a5-57a8de9db458 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:40.776203 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eeee0156-5742-4ba7-93a5-57a8de9db458 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:40.777234 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eeee0156-5742-4ba7-93a5-57a8de9db458 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:40.778748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eeee0156-5742-4ba7-93a5-57a8de9db458 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:40.779157 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-880950b2-c39f-43c6-968e-5b68b5a2288a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:40.779330 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eeee0156-5742-4ba7-93a5-57a8de9db458 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:40.779495 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-880950b2-c39f-43c6-968e-5b68b5a2288a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:40.779909 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-880950b2-c39f-43c6-968e-5b68b5a2288a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:40.780073 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eeee0156-5742-4ba7-93a5-57a8de9db458 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:40.780655 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-880950b2-c39f-43c6-968e-5b68b5a2288a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:40.781085 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-880950b2-c39f-43c6-968e-5b68b5a2288a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:40.781504 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-880950b2-c39f-43c6-968e-5b68b5a2288a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:40.822878 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-880950b2-c39f-43c6-968e-5b68b5a2288a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:40.823388 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-880950b2-c39f-43c6-968e-5b68b5a2288a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:40.823815 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-880950b2-c39f-43c6-968e-5b68b5a2288a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:40.824265 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-880950b2-c39f-43c6-968e-5b68b5a2288a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'fault' on Instance uuid b220de56-45f9-4761-8d48-e80cbc874ca2 {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:57:40.868486 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-880950b2-c39f-43c6-968e-5b68b5a2288a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:40.876924 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-880950b2-c39f-43c6-968e-5b68b5a2288a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 200 len: 1331 microversion: 2.1 time: 0.111487 Aug 26 08:57:40.888226 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 349/709] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:40 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:41.022815 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-eeee0156-5742-4ba7-93a5-57a8de9db458 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:41.047180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-eeee0156-5742-4ba7-93a5-57a8de9db458 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1724 microversion: 2.1 time: 0.280908 Aug 26 08:57:41.047880 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 361/710] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:40 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:41.118766 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e54e6345-43bd-4478-8a0f-93aba903be41 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:41.124483 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e54e6345-43bd-4478-8a0f-93aba903be41 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:41.154940 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e54e6345-43bd-4478-8a0f-93aba903be41 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:41.162419 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e54e6345-43bd-4478-8a0f-93aba903be41 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:41.164702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e54e6345-43bd-4478-8a0f-93aba903be41 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:41.166844 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e54e6345-43bd-4478-8a0f-93aba903be41 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:41.168478 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e54e6345-43bd-4478-8a0f-93aba903be41 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:41.169358 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e54e6345-43bd-4478-8a0f-93aba903be41 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:41.264162 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-d3c04c09-0627-4ba2-a18a-64a56793159d req-f5aa1707-ae5d-48ad-987f-6d77ad5f7551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbfe1e03-de30-4198-9a4d-a96708dbb98b", "tag": "57b16be7-70f7-4545-b557-e106d767a915"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:41.297824 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-d3c04c09-0627-4ba2-a18a-64a56793159d req-f5aa1707-ae5d-48ad-987f-6d77ad5f7551 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:41.300030 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-d3c04c09-0627-4ba2-a18a-64a56793159d req-f5aa1707-ae5d-48ad-987f-6d77ad5f7551 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:41.303575 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-d3c04c09-0627-4ba2-a18a-64a56793159d req-f5aa1707-ae5d-48ad-987f-6d77ad5f7551 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:41.334286 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-d3c04c09-0627-4ba2-a18a-64a56793159d req-f5aa1707-ae5d-48ad-987f-6d77ad5f7551 service nova] Creating event network-changed:57b16be7-70f7-4545-b557-e106d767a915 for instance cbfe1e03-de30-4198-9a4d-a96708dbb98b on hv-cinder-85236 Aug 26 08:57:41.339952 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-d3c04c09-0627-4ba2-a18a-64a56793159d req-f5aa1707-ae5d-48ad-987f-6d77ad5f7551 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084520 Aug 26 08:57:41.340627 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 362/711] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:57:41.346961 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-85632805-5449-4bc6-a415-d133e4b0a221 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:41.349606 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-85632805-5449-4bc6-a415-d133e4b0a221 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:41.377702 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-85632805-5449-4bc6-a415-d133e4b0a221 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:41.379356 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-85632805-5449-4bc6-a415-d133e4b0a221 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:41.380533 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-85632805-5449-4bc6-a415-d133e4b0a221 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:41.382697 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-85632805-5449-4bc6-a415-d133e4b0a221 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:41.383829 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-85632805-5449-4bc6-a415-d133e4b0a221 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:41.384846 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-85632805-5449-4bc6-a415-d133e4b0a221 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:41.449580 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-85632805-5449-4bc6-a415-d133e4b0a221 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107119 Aug 26 08:57:41.451162 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 363/712] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:57:41 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 08:57:41.549707 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-35198ec7-0ff4-495e-9d16-79ba8cc3a7b9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:41.550609 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-35198ec7-0ff4-495e-9d16-79ba8cc3a7b9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:41.564711 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35198ec7-0ff4-495e-9d16-79ba8cc3a7b9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:41.565527 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35198ec7-0ff4-495e-9d16-79ba8cc3a7b9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:41.566279 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35198ec7-0ff4-495e-9d16-79ba8cc3a7b9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:41.567689 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35198ec7-0ff4-495e-9d16-79ba8cc3a7b9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:41.568481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35198ec7-0ff4-495e-9d16-79ba8cc3a7b9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:41.569375 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35198ec7-0ff4-495e-9d16-79ba8cc3a7b9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:41.606989 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-35198ec7-0ff4-495e-9d16-79ba8cc3a7b9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 08:57:41.610422 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e54e6345-43bd-4478-8a0f-93aba903be41 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:41.625314 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e54e6345-43bd-4478-8a0f-93aba903be41 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1753 microversion: 2.1 time: 0.514277 Aug 26 08:57:41.640405 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 350/713] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:41 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1753 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:41.769633 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-35198ec7-0ff4-495e-9d16-79ba8cc3a7b9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "DELETE /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 204 len: 0 microversion: 2.1 time: 0.224078 Aug 26 08:57:41.772315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 364/714] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 08:57:41 2022] DELETE /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:57:41.787350 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-7b725920-e876-47ad-9a8a-dbc7ebe98428 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:41.788526 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-7b725920-e876-47ad-9a8a-dbc7ebe98428 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:41.799177 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b725920-e876-47ad-9a8a-dbc7ebe98428 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:41.799879 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b725920-e876-47ad-9a8a-dbc7ebe98428 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:41.800709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b725920-e876-47ad-9a8a-dbc7ebe98428 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:41.802056 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b725920-e876-47ad-9a8a-dbc7ebe98428 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:41.803343 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b725920-e876-47ad-9a8a-dbc7ebe98428 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:41.804276 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b725920-e876-47ad-9a8a-dbc7ebe98428 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:41.905104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-85e5eb1d-55b2-45f8-a10f-9439eba4ab3a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:41.905975 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-85e5eb1d-55b2-45f8-a10f-9439eba4ab3a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:41.918602 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-85e5eb1d-55b2-45f8-a10f-9439eba4ab3a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:41.919589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-85e5eb1d-55b2-45f8-a10f-9439eba4ab3a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:41.920512 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-85e5eb1d-55b2-45f8-a10f-9439eba4ab3a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:41.921689 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-85e5eb1d-55b2-45f8-a10f-9439eba4ab3a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:41.922516 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-85e5eb1d-55b2-45f8-a10f-9439eba4ab3a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:41.923473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-85e5eb1d-55b2-45f8-a10f-9439eba4ab3a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:41.942822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-85e5eb1d-55b2-45f8-a10f-9439eba4ab3a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] HTTP exception thrown: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-85e5eb1d-55b2-45f8-a10f-9439eba4ab3a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Request method failure captured: Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 HTTP/1.1 Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCIoEmQS0ltyE06Nj4PuDW7tRWlQx7ddVxbpmBorGEN4vH-Qi6t2BygustSi6IBEkokqI2I_SWwZYOmA6m8lhi8TWDRbttWpAHlEIqCkO0TFDD5IrIzdgnbzjwj6reGrNhrygHKk-ixwJbs_wRUzJRPtDT1VapHI831oEiCSS5Q537B4 Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 08:57:41.944646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 08:57:41.946250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f87dce6d7f01455fb8c3cfe128c20e72", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:57:41.946250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:57:41.946250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 08:57:41.946250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:57:41.946250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 08:57:41.946250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 08:57:41.946250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 08:57:41.946250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 406be06d6adf40bbb48d9baf12022988 Aug 26 08:57:41.946250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 08:57:41.946250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 08:57:41.946250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 08:57:41.946250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': 'b220de56-45f9-4761-8d48-e80cbc874ca2'} Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:57:41.947066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 08:57:41.948473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:57:41.950977 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-85e5eb1d-55b2-45f8-a10f-9439eba4ab3a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Returning 404 to user: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:57:41.951855 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-85e5eb1d-55b2-45f8-a10f-9439eba4ab3a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 404 len: 111 microversion: 2.1 time: 0.056221 Aug 26 08:57:41.952621 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 365/715] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:41 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:57:41.961387 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-dc5a7879-f92f-46ce-987a-77b245847970 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '.version_select at 0x7f1367debee0>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:41.973259 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7b725920-e876-47ad-9a8a-dbc7ebe98428 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:41.982404 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-7b725920-e876-47ad-9a8a-dbc7ebe98428 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1676 microversion: 2.1 time: 0.202479 Aug 26 08:57:41.983460 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 351/716] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:41 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1676 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:42.009545 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-dc5a7879-f92f-46ce-987a-77b245847970 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769815694" status: 202 len: 0 microversion: 2.1 time: 0.052220 Aug 26 08:57:42.010774 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 366/717] 10.222.0.71 () {58 vars in 1221 bytes} [Fri Aug 26 08:57:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769815694 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:57:42.071808 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-011ef89a-951e-4690-b4fd-70f63fdd5951 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:42.073832 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-011ef89a-951e-4690-b4fd-70f63fdd5951 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:42.086306 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-011ef89a-951e-4690-b4fd-70f63fdd5951 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:42.086961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-011ef89a-951e-4690-b4fd-70f63fdd5951 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:42.087581 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-011ef89a-951e-4690-b4fd-70f63fdd5951 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:42.088557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-011ef89a-951e-4690-b4fd-70f63fdd5951 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:42.089086 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-011ef89a-951e-4690-b4fd-70f63fdd5951 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:42.089605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-011ef89a-951e-4690-b4fd-70f63fdd5951 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:42.302117 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-011ef89a-951e-4690-b4fd-70f63fdd5951 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:42.317293 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-011ef89a-951e-4690-b4fd-70f63fdd5951 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1724 microversion: 2.1 time: 0.249970 Aug 26 08:57:42.319242 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 352/718] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:42 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:42.652284 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c920a1e5-8354-42f6-90ef-8a7b794e126f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:42.653261 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c920a1e5-8354-42f6-90ef-8a7b794e126f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:42.662433 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c920a1e5-8354-42f6-90ef-8a7b794e126f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:42.663217 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c920a1e5-8354-42f6-90ef-8a7b794e126f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:42.663939 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c920a1e5-8354-42f6-90ef-8a7b794e126f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:42.664930 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c920a1e5-8354-42f6-90ef-8a7b794e126f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:42.665657 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c920a1e5-8354-42f6-90ef-8a7b794e126f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:42.666270 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c920a1e5-8354-42f6-90ef-8a7b794e126f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:42.860540 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c920a1e5-8354-42f6-90ef-8a7b794e126f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:42.872583 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c920a1e5-8354-42f6-90ef-8a7b794e126f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.225560 Aug 26 08:57:42.874986 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 367/719] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:42 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:57:43.006332 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c0fddcaf-8644-4f60-9f34-5ca80311285b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:43.006833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c0fddcaf-8644-4f60-9f34-5ca80311285b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:43.013989 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c0fddcaf-8644-4f60-9f34-5ca80311285b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:43.014489 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c0fddcaf-8644-4f60-9f34-5ca80311285b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:43.015011 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c0fddcaf-8644-4f60-9f34-5ca80311285b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:43.015912 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c0fddcaf-8644-4f60-9f34-5ca80311285b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:43.016523 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c0fddcaf-8644-4f60-9f34-5ca80311285b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:43.017418 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c0fddcaf-8644-4f60-9f34-5ca80311285b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:43.022395 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-29f9fb88-1c46-4502-a068-6b38bf2380fd tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:43.023310 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-29f9fb88-1c46-4502-a068-6b38bf2380fd tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:43.033950 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-29f9fb88-1c46-4502-a068-6b38bf2380fd tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:43.035497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-29f9fb88-1c46-4502-a068-6b38bf2380fd tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:43.036538 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-29f9fb88-1c46-4502-a068-6b38bf2380fd tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:43.038348 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-29f9fb88-1c46-4502-a068-6b38bf2380fd tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:43.039519 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-29f9fb88-1c46-4502-a068-6b38bf2380fd tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:43.040573 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-29f9fb88-1c46-4502-a068-6b38bf2380fd tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:43.213824 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-c0fddcaf-8644-4f60-9f34-5ca80311285b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'services' on Instance uuid a2e441bb-c7f1-4f57-a936-ae82ddea56c5 {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:57:43.302091 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-29f9fb88-1c46-4502-a068-6b38bf2380fd tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:43.314759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-29f9fb88-1c46-4502-a068-6b38bf2380fd tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1676 microversion: 2.1 time: 0.295874 Aug 26 08:57:43.316889 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 368/720] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:43 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1676 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:57:43.339874 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b8812a87-7f5a-4473-9b39-bbb48081691b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:43.340484 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b8812a87-7f5a-4473-9b39-bbb48081691b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:43.349280 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b8812a87-7f5a-4473-9b39-bbb48081691b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:43.349899 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b8812a87-7f5a-4473-9b39-bbb48081691b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:43.350182 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b8812a87-7f5a-4473-9b39-bbb48081691b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:43.350877 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b8812a87-7f5a-4473-9b39-bbb48081691b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:43.351334 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b8812a87-7f5a-4473-9b39-bbb48081691b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:43.351753 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b8812a87-7f5a-4473-9b39-bbb48081691b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:43.401705 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c0fddcaf-8644-4f60-9f34-5ca80311285b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-volume_attachments/a8165260-2d93-4a05-907f-a9bfded863b7" status: 202 len: 0 microversion: 2.1 time: 0.399126 Aug 26 08:57:43.403970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 353/721] 10.222.0.71 () {58 vars in 1416 bytes} [Fri Aug 26 08:57:43 2022] DELETE /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-volume_attachments/a8165260-2d93-4a05-907f-a9bfded863b7 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:57:43.421478 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-537c6b40-ac02-43ec-9e0e-1703196f2b07 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:43.425227 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-537c6b40-ac02-43ec-9e0e-1703196f2b07 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:43.441879 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-537c6b40-ac02-43ec-9e0e-1703196f2b07 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:43.442381 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-537c6b40-ac02-43ec-9e0e-1703196f2b07 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:43.442808 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-537c6b40-ac02-43ec-9e0e-1703196f2b07 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:43.446644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-537c6b40-ac02-43ec-9e0e-1703196f2b07 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:43.447387 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-537c6b40-ac02-43ec-9e0e-1703196f2b07 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:43.447818 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-537c6b40-ac02-43ec-9e0e-1703196f2b07 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:43.495797 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-537c6b40-ac02-43ec-9e0e-1703196f2b07 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083457 Aug 26 08:57:43.496746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 354/722] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:57:43 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:57:43.696375 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b8812a87-7f5a-4473-9b39-bbb48081691b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:43.706118 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b8812a87-7f5a-4473-9b39-bbb48081691b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1724 microversion: 2.1 time: 0.370207 Aug 26 08:57:43.707053 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 369/723] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:43 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1724 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:57:43.907615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8f59d6cf-ca9a-494e-af1c-95be67b78a5d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:43.908575 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8f59d6cf-ca9a-494e-af1c-95be67b78a5d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:43.916768 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f59d6cf-ca9a-494e-af1c-95be67b78a5d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:43.917528 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f59d6cf-ca9a-494e-af1c-95be67b78a5d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:43.918223 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f59d6cf-ca9a-494e-af1c-95be67b78a5d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:43.919393 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f59d6cf-ca9a-494e-af1c-95be67b78a5d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:43.920092 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f59d6cf-ca9a-494e-af1c-95be67b78a5d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:43.920820 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f59d6cf-ca9a-494e-af1c-95be67b78a5d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:44.193837 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8f59d6cf-ca9a-494e-af1c-95be67b78a5d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:44.209047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8f59d6cf-ca9a-494e-af1c-95be67b78a5d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.310807 Aug 26 08:57:44.223715 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 355/724] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:43 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:44.338570 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9f48f5d4-4d78-4aa6-a38c-55b03db2890f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:44.339772 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9f48f5d4-4d78-4aa6-a38c-55b03db2890f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:44.347754 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9f48f5d4-4d78-4aa6-a38c-55b03db2890f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:44.348487 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9f48f5d4-4d78-4aa6-a38c-55b03db2890f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:44.349221 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9f48f5d4-4d78-4aa6-a38c-55b03db2890f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:44.350078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9f48f5d4-4d78-4aa6-a38c-55b03db2890f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:44.350664 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9f48f5d4-4d78-4aa6-a38c-55b03db2890f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:44.351223 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9f48f5d4-4d78-4aa6-a38c-55b03db2890f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:44.441952 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9f48f5d4-4d78-4aa6-a38c-55b03db2890f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:44.454440 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9f48f5d4-4d78-4aa6-a38c-55b03db2890f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1608 microversion: 2.1 time: 0.120103 Aug 26 08:57:44.455085 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 370/725] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:44 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1608 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:57:44.515371 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-05ddbdae-4ce5-4cfb-99be-e1d33be1d46c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:44.518431 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-05ddbdae-4ce5-4cfb-99be-e1d33be1d46c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:44.528607 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-05ddbdae-4ce5-4cfb-99be-e1d33be1d46c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:44.529450 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-05ddbdae-4ce5-4cfb-99be-e1d33be1d46c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:44.530805 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-05ddbdae-4ce5-4cfb-99be-e1d33be1d46c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:44.532703 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-05ddbdae-4ce5-4cfb-99be-e1d33be1d46c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:44.534516 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-05ddbdae-4ce5-4cfb-99be-e1d33be1d46c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:44.534691 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-05ddbdae-4ce5-4cfb-99be-e1d33be1d46c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:44.547467 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:44.593343 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-05ddbdae-4ce5-4cfb-99be-e1d33be1d46c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085052 Aug 26 08:57:44.595157 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 356/726] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:57:44 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:57:44.609971 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-33d68db5-61b9-49bc-b6dc-ecfe763d0e1d req-b3b7cdda-6206-4b85-8db4-223be57f3b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18845e10-a764-495f-b6fb-9b0858c695af", "name": "network-vif-deleted", "tag": "bacb0225-80ef-4914-92a8-9314236edf1a"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:44.621654 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-33d68db5-61b9-49bc-b6dc-ecfe763d0e1d req-b3b7cdda-6206-4b85-8db4-223be57f3b0c service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:44.622144 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-33d68db5-61b9-49bc-b6dc-ecfe763d0e1d req-b3b7cdda-6206-4b85-8db4-223be57f3b0c service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:44.622566 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-33d68db5-61b9-49bc-b6dc-ecfe763d0e1d req-b3b7cdda-6206-4b85-8db4-223be57f3b0c service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:44.637159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-33d68db5-61b9-49bc-b6dc-ecfe763d0e1d req-b3b7cdda-6206-4b85-8db4-223be57f3b0c service nova] Creating event network-vif-deleted:bacb0225-80ef-4914-92a8-9314236edf1a for instance 18845e10-a764-495f-b6fb-9b0858c695af on hv-cinder-85236 Aug 26 08:57:44.642353 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-33d68db5-61b9-49bc-b6dc-ecfe763d0e1d req-b3b7cdda-6206-4b85-8db4-223be57f3b0c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038114 Aug 26 08:57:44.643150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 371/727] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:57:44.734488 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4eee2502-f7c0-4965-8680-974f6c2ac68a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:44.735711 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4eee2502-f7c0-4965-8680-974f6c2ac68a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:44.746738 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4eee2502-f7c0-4965-8680-974f6c2ac68a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:44.748020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4eee2502-f7c0-4965-8680-974f6c2ac68a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:44.749435 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4eee2502-f7c0-4965-8680-974f6c2ac68a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:44.751093 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4eee2502-f7c0-4965-8680-974f6c2ac68a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:44.752260 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4eee2502-f7c0-4965-8680-974f6c2ac68a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:44.752842 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4eee2502-f7c0-4965-8680-974f6c2ac68a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:44.945629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-4eee2502-f7c0-4965-8680-974f6c2ac68a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:44.954909 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4eee2502-f7c0-4965-8680-974f6c2ac68a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1724 microversion: 2.1 time: 0.226831 Aug 26 08:57:44.955602 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 357/728] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:44 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:57:45.235002 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8a272bb3-5366-4a74-a5b1-9ff89efedaab tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:45.236524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8a272bb3-5366-4a74-a5b1-9ff89efedaab tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:45.243141 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a272bb3-5366-4a74-a5b1-9ff89efedaab tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:45.243634 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a272bb3-5366-4a74-a5b1-9ff89efedaab tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:45.244072 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a272bb3-5366-4a74-a5b1-9ff89efedaab tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:45.244769 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a272bb3-5366-4a74-a5b1-9ff89efedaab tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:45.245223 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a272bb3-5366-4a74-a5b1-9ff89efedaab tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:45.245646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8a272bb3-5366-4a74-a5b1-9ff89efedaab tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:45.423929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8a272bb3-5366-4a74-a5b1-9ff89efedaab tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:45.433558 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8a272bb3-5366-4a74-a5b1-9ff89efedaab tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.203482 Aug 26 08:57:45.434175 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 372/729] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:45 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:45.477777 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1784ddf2-31c2-4f5b-bf75-fcd8532b3aae tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:45.478388 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1784ddf2-31c2-4f5b-bf75-fcd8532b3aae tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:45.485143 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1784ddf2-31c2-4f5b-bf75-fcd8532b3aae tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:45.485642 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1784ddf2-31c2-4f5b-bf75-fcd8532b3aae tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:45.486078 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1784ddf2-31c2-4f5b-bf75-fcd8532b3aae tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:45.486774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1784ddf2-31c2-4f5b-bf75-fcd8532b3aae tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:45.487257 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1784ddf2-31c2-4f5b-bf75-fcd8532b3aae tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:45.487678 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1784ddf2-31c2-4f5b-bf75-fcd8532b3aae tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:45.563434 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1784ddf2-31c2-4f5b-bf75-fcd8532b3aae tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:45.573388 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1784ddf2-31c2-4f5b-bf75-fcd8532b3aae tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1608 microversion: 2.1 time: 0.099462 Aug 26 08:57:45.573956 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 358/730] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:45 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1608 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:45.609138 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a8b36a01-26da-42a3-b3dc-fded76b18049 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:45.611878 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a8b36a01-26da-42a3-b3dc-fded76b18049 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:45.619434 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a8b36a01-26da-42a3-b3dc-fded76b18049 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:45.620120 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a8b36a01-26da-42a3-b3dc-fded76b18049 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:45.620883 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a8b36a01-26da-42a3-b3dc-fded76b18049 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:45.621691 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a8b36a01-26da-42a3-b3dc-fded76b18049 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:45.622293 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a8b36a01-26da-42a3-b3dc-fded76b18049 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:45.622801 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a8b36a01-26da-42a3-b3dc-fded76b18049 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:45.817808 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a8b36a01-26da-42a3-b3dc-fded76b18049 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213394 Aug 26 08:57:45.818693 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 373/731] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:57:45 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:57:45.976442 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6621bf14-fe98-4266-886f-c52f4e3d1a9e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:45.977128 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6621bf14-fe98-4266-886f-c52f4e3d1a9e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:45.983707 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6621bf14-fe98-4266-886f-c52f4e3d1a9e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:45.984188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6621bf14-fe98-4266-886f-c52f4e3d1a9e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:45.984600 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6621bf14-fe98-4266-886f-c52f4e3d1a9e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:45.985286 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6621bf14-fe98-4266-886f-c52f4e3d1a9e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:45.985714 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6621bf14-fe98-4266-886f-c52f4e3d1a9e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:45.986139 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6621bf14-fe98-4266-886f-c52f4e3d1a9e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:46.158299 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6621bf14-fe98-4266-886f-c52f4e3d1a9e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:46.168127 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6621bf14-fe98-4266-886f-c52f4e3d1a9e tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1724 microversion: 2.1 time: 0.195418 Aug 26 08:57:46.168609 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 359/732] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:45 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:57:46.458800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a82a6ba5-fdea-4d2b-8fe3-494e494c0a61 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:46.459695 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a82a6ba5-fdea-4d2b-8fe3-494e494c0a61 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:46.466168 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a82a6ba5-fdea-4d2b-8fe3-494e494c0a61 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:46.466642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a82a6ba5-fdea-4d2b-8fe3-494e494c0a61 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:46.467103 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a82a6ba5-fdea-4d2b-8fe3-494e494c0a61 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:46.467901 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a82a6ba5-fdea-4d2b-8fe3-494e494c0a61 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:46.468354 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a82a6ba5-fdea-4d2b-8fe3-494e494c0a61 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:46.468768 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a82a6ba5-fdea-4d2b-8fe3-494e494c0a61 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:46.599110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fb8a9cb8-a87b-4daa-9db1-fc6b2bdc58b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:46.600507 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-fb8a9cb8-a87b-4daa-9db1-fc6b2bdc58b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:46.612828 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb8a9cb8-a87b-4daa-9db1-fc6b2bdc58b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:46.613319 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb8a9cb8-a87b-4daa-9db1-fc6b2bdc58b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:46.613761 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb8a9cb8-a87b-4daa-9db1-fc6b2bdc58b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:46.614523 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb8a9cb8-a87b-4daa-9db1-fc6b2bdc58b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:46.615439 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb8a9cb8-a87b-4daa-9db1-fc6b2bdc58b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:46.615871 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb8a9cb8-a87b-4daa-9db1-fc6b2bdc58b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:46.644729 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a82a6ba5-fdea-4d2b-8fe3-494e494c0a61 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:46.654184 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a82a6ba5-fdea-4d2b-8fe3-494e494c0a61 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.199970 Aug 26 08:57:46.654758 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 374/733] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:46 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:46.662817 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb8a9cb8-a87b-4daa-9db1-fc6b2bdc58b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:46.663420 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb8a9cb8-a87b-4daa-9db1-fc6b2bdc58b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:46.663874 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb8a9cb8-a87b-4daa-9db1-fc6b2bdc58b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:46.664550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-fb8a9cb8-a87b-4daa-9db1-fc6b2bdc58b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lazy-loading 'fault' on Instance uuid 18845e10-a764-495f-b6fb-9b0858c695af {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:57:46.707349 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-fb8a9cb8-a87b-4daa-9db1-fc6b2bdc58b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:46.716057 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fb8a9cb8-a87b-4daa-9db1-fc6b2bdc58b2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1328 microversion: 2.1 time: 0.122100 Aug 26 08:57:46.716650 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 360/734] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:46 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1328 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:46.833430 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-96fc248f-b477-4ad3-983d-644f3a72070b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:46.835459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-96fc248f-b477-4ad3-983d-644f3a72070b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:46.842697 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-96fc248f-b477-4ad3-983d-644f3a72070b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:46.843323 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-96fc248f-b477-4ad3-983d-644f3a72070b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:46.843751 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-96fc248f-b477-4ad3-983d-644f3a72070b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:46.844462 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-96fc248f-b477-4ad3-983d-644f3a72070b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:46.844911 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-96fc248f-b477-4ad3-983d-644f3a72070b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:46.845333 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-96fc248f-b477-4ad3-983d-644f3a72070b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:46.871503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:46.898136 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-96fc248f-b477-4ad3-983d-644f3a72070b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069108 Aug 26 08:57:46.899197 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 375/735] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:57:46 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:57:47.192882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ea4917ae-8f72-4ffa-adf4-385e6d2f5abf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:47.193517 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ea4917ae-8f72-4ffa-adf4-385e6d2f5abf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:47.199908 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ea4917ae-8f72-4ffa-adf4-385e6d2f5abf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:47.200361 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ea4917ae-8f72-4ffa-adf4-385e6d2f5abf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:47.200791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ea4917ae-8f72-4ffa-adf4-385e6d2f5abf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:47.201484 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ea4917ae-8f72-4ffa-adf4-385e6d2f5abf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:47.201935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ea4917ae-8f72-4ffa-adf4-385e6d2f5abf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:47.202413 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ea4917ae-8f72-4ffa-adf4-385e6d2f5abf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:47.351606 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ea4917ae-8f72-4ffa-adf4-385e6d2f5abf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:47.361984 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ea4917ae-8f72-4ffa-adf4-385e6d2f5abf tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1730 microversion: 2.1 time: 0.172869 Aug 26 08:57:47.362604 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 361/736] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:47 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:47.389728 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ae68844d-286a-4f56-9241-1581a19e9d02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:47.391175 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ae68844d-286a-4f56-9241-1581a19e9d02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:47.399178 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ae68844d-286a-4f56-9241-1581a19e9d02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:47.399772 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ae68844d-286a-4f56-9241-1581a19e9d02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:47.400213 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ae68844d-286a-4f56-9241-1581a19e9d02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:47.400976 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ae68844d-286a-4f56-9241-1581a19e9d02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:47.401431 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ae68844d-286a-4f56-9241-1581a19e9d02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:47.401855 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ae68844d-286a-4f56-9241-1581a19e9d02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:47.492780 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ae68844d-286a-4f56-9241-1581a19e9d02 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112966 Aug 26 08:57:47.493486 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 376/737] 10.222.0.71 () {58 vars in 1275 bytes} [Fri Aug 26 08:57:47 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:57:47.677068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-51013a1c-7097-4651-a631-2e3d5165ac84 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:47.678101 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-51013a1c-7097-4651-a631-2e3d5165ac84 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:47.689288 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-51013a1c-7097-4651-a631-2e3d5165ac84 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:47.690591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-51013a1c-7097-4651-a631-2e3d5165ac84 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:47.691686 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-51013a1c-7097-4651-a631-2e3d5165ac84 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:47.693533 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-51013a1c-7097-4651-a631-2e3d5165ac84 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:47.694547 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-51013a1c-7097-4651-a631-2e3d5165ac84 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:47.695559 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-51013a1c-7097-4651-a631-2e3d5165ac84 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:47.740258 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-182c4af6-1dd7-4107-a799-38c46be30b67 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:47.741300 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-182c4af6-1dd7-4107-a799-38c46be30b67 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:47.751241 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-182c4af6-1dd7-4107-a799-38c46be30b67 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:47.752647 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-182c4af6-1dd7-4107-a799-38c46be30b67 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:47.753765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-182c4af6-1dd7-4107-a799-38c46be30b67 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:47.755895 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-182c4af6-1dd7-4107-a799-38c46be30b67 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:47.756662 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-182c4af6-1dd7-4107-a799-38c46be30b67 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:47.757509 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-182c4af6-1dd7-4107-a799-38c46be30b67 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:47.801968 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-182c4af6-1dd7-4107-a799-38c46be30b67 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:47.802774 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-182c4af6-1dd7-4107-a799-38c46be30b67 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:47.803461 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-182c4af6-1dd7-4107-a799-38c46be30b67 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:47.804128 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-182c4af6-1dd7-4107-a799-38c46be30b67 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lazy-loading 'fault' on Instance uuid 18845e10-a764-495f-b6fb-9b0858c695af {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:57:47.865968 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-182c4af6-1dd7-4107-a799-38c46be30b67 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:47.874709 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-182c4af6-1dd7-4107-a799-38c46be30b67 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1328 microversion: 2.1 time: 0.140513 Aug 26 08:57:47.875548 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 377/738] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:47 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1328 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:57:47.913860 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8cecae0a-cf8c-464a-adfd-6283ed7233c5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:47.917193 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8cecae0a-cf8c-464a-adfd-6283ed7233c5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:47.925369 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8cecae0a-cf8c-464a-adfd-6283ed7233c5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:47.925812 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8cecae0a-cf8c-464a-adfd-6283ed7233c5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:47.926568 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8cecae0a-cf8c-464a-adfd-6283ed7233c5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:47.927276 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8cecae0a-cf8c-464a-adfd-6283ed7233c5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:47.927677 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8cecae0a-cf8c-464a-adfd-6283ed7233c5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:47.928097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8cecae0a-cf8c-464a-adfd-6283ed7233c5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:47.969448 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8cecae0a-cf8c-464a-adfd-6283ed7233c5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060133 Aug 26 08:57:47.976008 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 378/739] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:57:47 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 08:57:48.004392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-51013a1c-7097-4651-a631-2e3d5165ac84 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:48.014483 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-51013a1c-7097-4651-a631-2e3d5165ac84 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.342219 Aug 26 08:57:48.015086 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 362/740] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:47 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:48.045682 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0fe3415f-46d1-4bc7-b6a8-c03f074386f8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:48.049996 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0fe3415f-46d1-4bc7-b6a8-c03f074386f8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:48.055404 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0fe3415f-46d1-4bc7-b6a8-c03f074386f8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:48.055901 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0fe3415f-46d1-4bc7-b6a8-c03f074386f8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:48.056330 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0fe3415f-46d1-4bc7-b6a8-c03f074386f8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:48.057040 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0fe3415f-46d1-4bc7-b6a8-c03f074386f8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:48.057497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0fe3415f-46d1-4bc7-b6a8-c03f074386f8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:48.057909 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0fe3415f-46d1-4bc7-b6a8-c03f074386f8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:48.089572 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0fe3415f-46d1-4bc7-b6a8-c03f074386f8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 08:57:48.189225 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0fe3415f-46d1-4bc7-b6a8-c03f074386f8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 204 len: 0 microversion: 2.1 time: 0.147133 Aug 26 08:57:48.189882 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 379/741] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 08:57:48 2022] DELETE /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:57:48.199030 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b9adcab4-da31-4fc2-a500-64398dc7cb05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:48.199639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b9adcab4-da31-4fc2-a500-64398dc7cb05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:48.207289 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9adcab4-da31-4fc2-a500-64398dc7cb05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:48.207779 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9adcab4-da31-4fc2-a500-64398dc7cb05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:48.208218 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9adcab4-da31-4fc2-a500-64398dc7cb05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:48.208927 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9adcab4-da31-4fc2-a500-64398dc7cb05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:48.209423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9adcab4-da31-4fc2-a500-64398dc7cb05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:48.209880 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9adcab4-da31-4fc2-a500-64398dc7cb05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:48.705395 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b9adcab4-da31-4fc2-a500-64398dc7cb05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:48.715661 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b9adcab4-da31-4fc2-a500-64398dc7cb05 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1682 microversion: 2.1 time: 0.520943 Aug 26 08:57:48.716501 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 363/742] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:48 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1682 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:57:48.898429 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a6f491ca-abe9-4193-b7e1-d52f061a7d77 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:48.899396 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a6f491ca-abe9-4193-b7e1-d52f061a7d77 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:48.906171 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a6f491ca-abe9-4193-b7e1-d52f061a7d77 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:48.906641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a6f491ca-abe9-4193-b7e1-d52f061a7d77 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:48.907117 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a6f491ca-abe9-4193-b7e1-d52f061a7d77 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:48.907985 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a6f491ca-abe9-4193-b7e1-d52f061a7d77 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:48.908346 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a6f491ca-abe9-4193-b7e1-d52f061a7d77 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:48.908728 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a6f491ca-abe9-4193-b7e1-d52f061a7d77 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:48.953241 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a6f491ca-abe9-4193-b7e1-d52f061a7d77 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:48.953860 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a6f491ca-abe9-4193-b7e1-d52f061a7d77 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:48.954357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a6f491ca-abe9-4193-b7e1-d52f061a7d77 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:48.954819 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-a6f491ca-abe9-4193-b7e1-d52f061a7d77 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lazy-loading 'fault' on Instance uuid 18845e10-a764-495f-b6fb-9b0858c695af {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:57:49.007610 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-0595884a-782e-42a4-86dd-a667b59103bb req-1aa42ecf-18c8-4973-9a56-796e82c30177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1704235c-9819-4980-9ee0-b46ecd91de2e", "tag": "a81dfa72-6e98-4baf-ad11-0355ffe802a1"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:49.027748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a6f491ca-abe9-4193-b7e1-d52f061a7d77 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:49.029601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-0595884a-782e-42a4-86dd-a667b59103bb req-1aa42ecf-18c8-4973-9a56-796e82c30177 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:49.031225 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-0595884a-782e-42a4-86dd-a667b59103bb req-1aa42ecf-18c8-4973-9a56-796e82c30177 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:49.031823 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-0595884a-782e-42a4-86dd-a667b59103bb req-1aa42ecf-18c8-4973-9a56-796e82c30177 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:49.044776 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a6f491ca-abe9-4193-b7e1-d52f061a7d77 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1328 microversion: 2.1 time: 0.150729 Aug 26 08:57:49.046330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-0595884a-782e-42a4-86dd-a667b59103bb req-1aa42ecf-18c8-4973-9a56-796e82c30177 service nova] Creating event network-changed:a81dfa72-6e98-4baf-ad11-0355ffe802a1 for instance 1704235c-9819-4980-9ee0-b46ecd91de2e on hv-cinder-85236 Aug 26 08:57:49.046555 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 380/743] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:48 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1328 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:49.052885 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-cc262dd2-21ef-48d7-b936-32ae1a3573a7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:49.053574 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-cc262dd2-21ef-48d7-b936-32ae1a3573a7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:49.055317 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-0595884a-782e-42a4-86dd-a667b59103bb req-1aa42ecf-18c8-4973-9a56-796e82c30177 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051787 Aug 26 08:57:49.056010 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 364/744] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:57:49.060777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cc262dd2-21ef-48d7-b936-32ae1a3573a7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:49.061337 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cc262dd2-21ef-48d7-b936-32ae1a3573a7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:49.061839 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cc262dd2-21ef-48d7-b936-32ae1a3573a7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:49.062748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cc262dd2-21ef-48d7-b936-32ae1a3573a7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:49.063300 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cc262dd2-21ef-48d7-b936-32ae1a3573a7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:49.063795 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cc262dd2-21ef-48d7-b936-32ae1a3573a7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:49.229044 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-cc262dd2-21ef-48d7-b936-32ae1a3573a7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:49.239548 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-cc262dd2-21ef-48d7-b936-32ae1a3573a7 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.190985 Aug 26 08:57:49.240125 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 381/745] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:49 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:49.740410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-5df5fc03-f085-4c3b-ae34-93b13481c95f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:49.741338 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-5df5fc03-f085-4c3b-ae34-93b13481c95f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:49.748618 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5df5fc03-f085-4c3b-ae34-93b13481c95f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:49.749188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5df5fc03-f085-4c3b-ae34-93b13481c95f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:49.749628 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5df5fc03-f085-4c3b-ae34-93b13481c95f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:49.750331 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5df5fc03-f085-4c3b-ae34-93b13481c95f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:49.750778 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5df5fc03-f085-4c3b-ae34-93b13481c95f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:49.751249 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5df5fc03-f085-4c3b-ae34-93b13481c95f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:49.900114 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-5df5fc03-f085-4c3b-ae34-93b13481c95f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:49.918296 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-5df5fc03-f085-4c3b-ae34-93b13481c95f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1682 microversion: 2.1 time: 0.183387 Aug 26 08:57:49.919400 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 365/746] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:49 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:50.075509 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5b18a7b3-ef74-4e58-826c-fe7c533c8408 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:50.076093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5b18a7b3-ef74-4e58-826c-fe7c533c8408 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:50.084515 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5b18a7b3-ef74-4e58-826c-fe7c533c8408 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:50.085235 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5b18a7b3-ef74-4e58-826c-fe7c533c8408 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:50.085670 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5b18a7b3-ef74-4e58-826c-fe7c533c8408 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:50.086386 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5b18a7b3-ef74-4e58-826c-fe7c533c8408 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:50.086827 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5b18a7b3-ef74-4e58-826c-fe7c533c8408 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:50.087295 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5b18a7b3-ef74-4e58-826c-fe7c533c8408 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:50.120994 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5b18a7b3-ef74-4e58-826c-fe7c533c8408 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:50.121475 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5b18a7b3-ef74-4e58-826c-fe7c533c8408 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:50.121911 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5b18a7b3-ef74-4e58-826c-fe7c533c8408 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:50.122370 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-5b18a7b3-ef74-4e58-826c-fe7c533c8408 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lazy-loading 'fault' on Instance uuid 18845e10-a764-495f-b6fb-9b0858c695af {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:57:50.168816 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5b18a7b3-ef74-4e58-826c-fe7c533c8408 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:50.177573 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5b18a7b3-ef74-4e58-826c-fe7c533c8408 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 200 len: 1328 microversion: 2.1 time: 0.106326 Aug 26 08:57:50.178283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 382/747] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:50 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:50.261998 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b7ce2c6b-5969-4a90-9ac7-6fd829e65324 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:50.262624 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b7ce2c6b-5969-4a90-9ac7-6fd829e65324 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:50.268998 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b7ce2c6b-5969-4a90-9ac7-6fd829e65324 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:50.269491 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b7ce2c6b-5969-4a90-9ac7-6fd829e65324 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:50.269890 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b7ce2c6b-5969-4a90-9ac7-6fd829e65324 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:50.270575 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b7ce2c6b-5969-4a90-9ac7-6fd829e65324 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:50.271062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b7ce2c6b-5969-4a90-9ac7-6fd829e65324 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:50.271463 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b7ce2c6b-5969-4a90-9ac7-6fd829e65324 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:50.428499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b7ce2c6b-5969-4a90-9ac7-6fd829e65324 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:50.438859 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b7ce2c6b-5969-4a90-9ac7-6fd829e65324 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.180870 Aug 26 08:57:50.439510 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 366/748] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:50 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:57:50.946298 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-aaf2d660-58bb-430a-b8ed-d87f75fc04d2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:50.947926 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-aaf2d660-58bb-430a-b8ed-d87f75fc04d2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:50.961074 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aaf2d660-58bb-430a-b8ed-d87f75fc04d2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:50.962201 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aaf2d660-58bb-430a-b8ed-d87f75fc04d2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:50.963065 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aaf2d660-58bb-430a-b8ed-d87f75fc04d2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:50.964245 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aaf2d660-58bb-430a-b8ed-d87f75fc04d2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:50.965075 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aaf2d660-58bb-430a-b8ed-d87f75fc04d2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:50.965856 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aaf2d660-58bb-430a-b8ed-d87f75fc04d2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:51.122987 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-01f22377-a953-417d-827c-e04c98e4e297 req-01754929-2aae-40da-9d0b-c2dd3536f1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1704235c-9819-4980-9ee0-b46ecd91de2e", "tag": "a81dfa72-6e98-4baf-ad11-0355ffe802a1"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:51.157731 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-01f22377-a953-417d-827c-e04c98e4e297 req-01754929-2aae-40da-9d0b-c2dd3536f1c1 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:51.158100 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-01f22377-a953-417d-827c-e04c98e4e297 req-01754929-2aae-40da-9d0b-c2dd3536f1c1 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:51.158540 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-01f22377-a953-417d-827c-e04c98e4e297 req-01754929-2aae-40da-9d0b-c2dd3536f1c1 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:51.186838 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-01f22377-a953-417d-827c-e04c98e4e297 req-01754929-2aae-40da-9d0b-c2dd3536f1c1 service nova] Creating event network-changed:a81dfa72-6e98-4baf-ad11-0355ffe802a1 for instance 1704235c-9819-4980-9ee0-b46ecd91de2e on hv-cinder-85236 Aug 26 08:57:51.207443 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-01f22377-a953-417d-827c-e04c98e4e297 req-01754929-2aae-40da-9d0b-c2dd3536f1c1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087959 Aug 26 08:57:51.210786 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 367/749] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:57:51.235773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-dd5554e5-e903-4a60-90e5-2570fc1d5e8a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:51.237420 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-dd5554e5-e903-4a60-90e5-2570fc1d5e8a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:51.253678 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd5554e5-e903-4a60-90e5-2570fc1d5e8a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:51.255890 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd5554e5-e903-4a60-90e5-2570fc1d5e8a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:51.256586 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd5554e5-e903-4a60-90e5-2570fc1d5e8a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:51.257494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd5554e5-e903-4a60-90e5-2570fc1d5e8a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:51.258168 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd5554e5-e903-4a60-90e5-2570fc1d5e8a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:51.259433 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dd5554e5-e903-4a60-90e5-2570fc1d5e8a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:51.292909 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-dd5554e5-e903-4a60-90e5-2570fc1d5e8a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] HTTP exception thrown: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-dd5554e5-e903-4a60-90e5-2570fc1d5e8a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Request method failure captured: Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af HTTP/1.1 Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCImguVpKK9Zk12eHtdVnDAzA6zfNo8OXZ-0mqTIIC0_O27LWymZVUab31e13DoTMkNQDVat7VUAxDgq2dwu1DluYKlsMwAgD9IR75Z8cYk0g3ORN88-GU3_fROH_xMCR-6I2VABTKwzG5k3JT0G68Wv1gBHTdY5CH15K2YL343ThESc Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 88aa61636dd846f0a95be974b6b99d05 Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeTestJSON-39276367 Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 08:57:51.298392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 08:57:51.300535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_88aa61636dd846f0a95be974b6b99d05", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:57:51.300535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeTestJSON-39276367 Aug 26 08:57:51.300535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 88aa61636dd846f0a95be974b6b99d05 Aug 26 08:57:51.300535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeTestJSON-39276367 Aug 26 08:57:51.300535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeTestJSON-39276367-project Aug 26 08:57:51.300535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 08:57:51.300535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 08:57:51.300535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: b6f722499abc409a8a345bcb70114eaf Aug 26 08:57:51.300535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeTestJSON-39276367-project Aug 26 08:57:51.300535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 08:57:51.300535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 08:57:51.300535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '18845e10-a764-495f-b6fb-9b0858c695af'} Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:57:51.301977 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 08:57:51.303456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:51.308081 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-dd5554e5-e903-4a60-90e5-2570fc1d5e8a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Returning 404 to user: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:57:51.309261 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-dd5554e5-e903-4a60-90e5-2570fc1d5e8a tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 404 len: 111 microversion: 2.1 time: 0.096840 Aug 26 08:57:51.314450 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 368/750] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:51 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:57:51.330230 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-aaf2d660-58bb-430a-b8ed-d87f75fc04d2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:51.339673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-13d5d31b-295a-4984-b2e5-71d010bb820d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '.version_select at 0x7f1367f24790>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:51.381865 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-aaf2d660-58bb-430a-b8ed-d87f75fc04d2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1682 microversion: 2.1 time: 0.441576 Aug 26 08:57:51.382541 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 383/751] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:50 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1682 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:57:51.418024 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-13d5d31b-295a-4984-b2e5-71d010bb820d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1961307273" status: 202 len: 0 microversion: 2.1 time: 0.095584 Aug 26 08:57:51.418840 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 369/752] 10.222.0.71 () {58 vars in 1221 bytes} [Fri Aug 26 08:57:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1961307273 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:57:51.475328 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-76298e03-dfea-4490-8d29-17c773810936 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:51.481423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-76298e03-dfea-4490-8d29-17c773810936 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:51.506805 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-76298e03-dfea-4490-8d29-17c773810936 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:51.511636 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-76298e03-dfea-4490-8d29-17c773810936 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:51.512179 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-76298e03-dfea-4490-8d29-17c773810936 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:51.513408 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-76298e03-dfea-4490-8d29-17c773810936 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:51.514368 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-76298e03-dfea-4490-8d29-17c773810936 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:51.514959 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-76298e03-dfea-4490-8d29-17c773810936 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:51.773238 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-76298e03-dfea-4490-8d29-17c773810936 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:51.795505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-76298e03-dfea-4490-8d29-17c773810936 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.336388 Aug 26 08:57:51.809334 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 384/753] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:51 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:52.412385 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c19a262e-46e2-44f4-ae6d-aafa044452b5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:52.413343 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c19a262e-46e2-44f4-ae6d-aafa044452b5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:52.421583 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c19a262e-46e2-44f4-ae6d-aafa044452b5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:52.422445 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c19a262e-46e2-44f4-ae6d-aafa044452b5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:52.423099 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c19a262e-46e2-44f4-ae6d-aafa044452b5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:52.423848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c19a262e-46e2-44f4-ae6d-aafa044452b5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:52.424506 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c19a262e-46e2-44f4-ae6d-aafa044452b5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:52.425111 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c19a262e-46e2-44f4-ae6d-aafa044452b5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:52.573275 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c19a262e-46e2-44f4-ae6d-aafa044452b5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:52.602394 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c19a262e-46e2-44f4-ae6d-aafa044452b5 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1615 microversion: 2.1 time: 0.193824 Aug 26 08:57:52.615546 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 370/754] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:52 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1615 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:57:52.821801 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f8f15bc5-bfdf-4710-af67-2cf6491364ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:52.823154 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f8f15bc5-bfdf-4710-af67-2cf6491364ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:52.831062 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f8f15bc5-bfdf-4710-af67-2cf6491364ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:52.831412 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f8f15bc5-bfdf-4710-af67-2cf6491364ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:52.831849 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f8f15bc5-bfdf-4710-af67-2cf6491364ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:52.832767 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f8f15bc5-bfdf-4710-af67-2cf6491364ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:52.833232 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f8f15bc5-bfdf-4710-af67-2cf6491364ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:52.833772 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f8f15bc5-bfdf-4710-af67-2cf6491364ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:53.099370 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c3bda225-1dec-49ac-b1cd-d147d121570c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Action: 'create', calling method: .version_select at 0x7f136c065670>, body: {"keypair": {"name": "tempest-keypair-535697418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvSH1CMiBrYz75uiZPfT6JK9QlFrfwpVVYizElZl5M8vPvty9MWbk2HBd6z9TBHx/cxpg5oXWDMuhBzggLR2zFYsmrP88dobcjEYli5qpjTCnH/EfRV1MpLYfKCsOAHBQ=="}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:53.120660 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-c3bda225-1dec-49ac-b1cd-d147d121570c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Getting quotas for project 88aa61636dd846f0a95be974b6b99d05. Resources: {'key_pairs'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:57:53.131303 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-c3bda225-1dec-49ac-b1cd-d147d121570c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Getting quotas for user b6f722499abc409a8a345bcb70114eaf and project 88aa61636dd846f0a95be974b6b99d05. Resources: {'key_pairs'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:57:53.165377 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c3bda225-1dec-49ac-b1cd-d147d121570c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070231 Aug 26 08:57:53.168401 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 371/755] 10.222.0.71 () {60 vars in 1159 bytes} [Fri Aug 26 08:57:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:57:53.184385 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f8f15bc5-bfdf-4710-af67-2cf6491364ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:53.198681 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f8f15bc5-bfdf-4710-af67-2cf6491364ed tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.383781 Aug 26 08:57:53.200434 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 385/756] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:52 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:53.295070 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-37495058-a318-4de0-8753-4fe79876baa1 req-8324834f-1d71-489c-a7b3-76f81e382fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e441bb-c7f1-4f57-a936-ae82ddea56c5", "name": "network-vif-deleted", "tag": "577f1e58-da5c-4628-a0bd-bcf24fc8842e"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:53.305768 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-37495058-a318-4de0-8753-4fe79876baa1 req-8324834f-1d71-489c-a7b3-76f81e382fe6 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:53.306235 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-37495058-a318-4de0-8753-4fe79876baa1 req-8324834f-1d71-489c-a7b3-76f81e382fe6 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:53.306810 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-37495058-a318-4de0-8753-4fe79876baa1 req-8324834f-1d71-489c-a7b3-76f81e382fe6 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:53.321054 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-37495058-a318-4de0-8753-4fe79876baa1 req-8324834f-1d71-489c-a7b3-76f81e382fe6 service nova] Creating event network-vif-deleted:577f1e58-da5c-4628-a0bd-bcf24fc8842e for instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 on hv-cinder-85236 Aug 26 08:57:53.326847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-37495058-a318-4de0-8753-4fe79876baa1 req-8324834f-1d71-489c-a7b3-76f81e382fe6 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036599 Aug 26 08:57:53.327556 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 372/757] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:57:53.626407 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6510588b-6cea-4819-91e8-30f1c95d4fe7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:53.628200 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6510588b-6cea-4819-91e8-30f1c95d4fe7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:53.636222 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6510588b-6cea-4819-91e8-30f1c95d4fe7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:53.637620 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6510588b-6cea-4819-91e8-30f1c95d4fe7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:53.652157 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6510588b-6cea-4819-91e8-30f1c95d4fe7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:53.653169 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6510588b-6cea-4819-91e8-30f1c95d4fe7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:53.653628 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6510588b-6cea-4819-91e8-30f1c95d4fe7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:53.654157 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6510588b-6cea-4819-91e8-30f1c95d4fe7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:53.701819 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6510588b-6cea-4819-91e8-30f1c95d4fe7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:53.702451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6510588b-6cea-4819-91e8-30f1c95d4fe7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:53.702922 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6510588b-6cea-4819-91e8-30f1c95d4fe7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:53.703390 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-6510588b-6cea-4819-91e8-30f1c95d4fe7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'fault' on Instance uuid a2e441bb-c7f1-4f57-a936-ae82ddea56c5 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:57:53.832806 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6510588b-6cea-4819-91e8-30f1c95d4fe7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:53.847215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6510588b-6cea-4819-91e8-30f1c95d4fe7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 200 len: 1332 microversion: 2.1 time: 0.224671 Aug 26 08:57:53.848553 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 386/758] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:53 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 1332 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:54.223120 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-98dbb3d8-8ef3-4a1e-906c-7ed2c38e6845 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:54.224408 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-98dbb3d8-8ef3-4a1e-906c-7ed2c38e6845 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:54.231142 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-98dbb3d8-8ef3-4a1e-906c-7ed2c38e6845 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:54.231567 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-98dbb3d8-8ef3-4a1e-906c-7ed2c38e6845 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:54.231995 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-98dbb3d8-8ef3-4a1e-906c-7ed2c38e6845 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:54.232705 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-98dbb3d8-8ef3-4a1e-906c-7ed2c38e6845 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:54.233245 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-98dbb3d8-8ef3-4a1e-906c-7ed2c38e6845 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:54.233729 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-98dbb3d8-8ef3-4a1e-906c-7ed2c38e6845 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:54.409322 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-98dbb3d8-8ef3-4a1e-906c-7ed2c38e6845 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:54.418312 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-98dbb3d8-8ef3-4a1e-906c-7ed2c38e6845 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.200272 Aug 26 08:57:54.418959 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 373/759] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:54 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:54.874581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1566985913", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b89dcda-85d5-4bc7-8c82-22c051e5c000"}], "security_groups": [{"name": "tempest-securitygroup--1128069916"}], "key_name": "tempest-keypair-535697418", "user_data": "}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:54.882419 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-897a454c-398c-4cbe-827e-4ca7181c19dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:54.883542 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-897a454c-398c-4cbe-827e-4ca7181c19dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:54.891018 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-897a454c-398c-4cbe-827e-4ca7181c19dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:54.891633 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-897a454c-398c-4cbe-827e-4ca7181c19dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:54.892004 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-897a454c-398c-4cbe-827e-4ca7181c19dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:54.892777 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-897a454c-398c-4cbe-827e-4ca7181c19dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:54.893224 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-897a454c-398c-4cbe-827e-4ca7181c19dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:54.893672 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-897a454c-398c-4cbe-827e-4ca7181c19dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:54.909396 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-897a454c-398c-4cbe-827e-4ca7181c19dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] HTTP exception thrown: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-897a454c-398c-4cbe-827e-4ca7181c19dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Request method failure captured: Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 HTTP/1.1 Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIoEmQS0ltyE06Nj4PuDW7tRWlQx7ddVxbpmBorGEN4vH-Qi6t2BygustSi6IBEkokqI2I_SWwZYOmA6m8lhi8TWDRbttWpAHlEIqCkO0TFDD5IrIzdgnbzjwj6reGrNhrygHKk-ixwJbs_wRUzJRPtDT1VapHI831oEiCSS5Q537B4 Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 08:57:54.911130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 08:57:54.912803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f87dce6d7f01455fb8c3cfe128c20e72", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:57:54.912803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:57:54.912803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 08:57:54.912803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:57:54.912803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 08:57:54.912803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 08:57:54.912803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 08:57:54.912803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 406be06d6adf40bbb48d9baf12022988 Aug 26 08:57:54.912803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 08:57:54.912803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 08:57:54.912803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 08:57:54.912803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': 'a2e441bb-c7f1-4f57-a936-ae82ddea56c5'} Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:57:54.913692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 08:57:54.915212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:57:54.916748 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-897a454c-398c-4cbe-827e-4ca7181c19dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Returning 404 to user: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:57:54.916748 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-897a454c-398c-4cbe-827e-4ca7181c19dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 404 len: 111 microversion: 2.1 time: 0.037969 Aug 26 08:57:54.916748 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 374/760] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:54 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:57:54.927007 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-bca305bc-d819-43d8-a971-6bdcf1e7d867 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '.version_select at 0x7f1367fc1d30>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:54.957776 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-bca305bc-d819-43d8-a971-6bdcf1e7d867 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241427218" status: 202 len: 0 microversion: 2.1 time: 0.037031 Aug 26 08:57:54.958757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 375/761] 10.222.0.71 () {58 vars in 1221 bytes} [Fri Aug 26 08:57:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241427218 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 08:57:55.006180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.network.neutron [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] validate_networks() for [('7b89dcda-85d5-4bc7-8c82-22c051e5c000', None, None, None, None, None)] {{(pid=132218) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:57:55.441886 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8a29142d-ef07-4260-bcf4-1377edd0a7e4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:55.442753 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8a29142d-ef07-4260-bcf4-1377edd0a7e4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:55.452664 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8a29142d-ef07-4260-bcf4-1377edd0a7e4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:55.453415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8a29142d-ef07-4260-bcf4-1377edd0a7e4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:55.454108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8a29142d-ef07-4260-bcf4-1377edd0a7e4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:55.455218 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8a29142d-ef07-4260-bcf4-1377edd0a7e4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:55.455954 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8a29142d-ef07-4260-bcf4-1377edd0a7e4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:55.456852 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8a29142d-ef07-4260-bcf4-1377edd0a7e4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:55.651246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8a29142d-ef07-4260-bcf4-1377edd0a7e4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:55.660375 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8a29142d-ef07-4260-bcf4-1377edd0a7e4 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.223400 Aug 26 08:57:55.660999 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 376/762] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:55 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:57:55.681819 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Flavor limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:57:55.682427 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Image limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:57:55.683070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Flavor pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:57:55.683488 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Image pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:57:55.683964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:57:55.696447 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:55.697107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:55.697670 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:55.698453 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:55.699332 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:55.699925 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:55.713136 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:55.721137 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Getting quotas for project 88aa61636dd846f0a95be974b6b99d05. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:57:55.726867 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Getting quotas for user b6f722499abc409a8a345bcb70114eaf and project 88aa61636dd846f0a95be974b6b99d05. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:57:55.740366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Going to run 1 instances... {{(pid=132218) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:57:55.743325 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132218) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:57:55.802431 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8da5de75-a72d-4b27-a387-b021e4a0f4d3 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.931197 Aug 26 08:57:55.802431 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 387/763] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:57:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 08:57:55.812877 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d855bdff-5179-4bcc-bc79-020e1f2ca7d0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:55.813600 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d855bdff-5179-4bcc-bc79-020e1f2ca7d0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:55.880240 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d855bdff-5179-4bcc-bc79-020e1f2ca7d0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:55.889682 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-20f21c54-a99e-48ee-8c24-c04d564345e2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Action: 'create', calling method: .version_select at 0x7f1367da5e50>, body: {"keypair": {"name": "tempest-keypair-858458509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO92JE3YGA4XnA5wBXYS4w38v1IHwHj/rusg5w5xfBmvfHIPDyaSbitP6FVKPjgwSVxdIylG819yC+FviPvuLCLjFRV1pd8G8MwBQq0APooFcATghpNp086TRSE6mKydWg=="}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:55.890502 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d855bdff-5179-4bcc-bc79-020e1f2ca7d0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1237 microversion: 2.1 time: 0.081882 Aug 26 08:57:55.891148 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 377/764] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:55 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:55.918212 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-20f21c54-a99e-48ee-8c24-c04d564345e2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'key_pairs'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:57:55.922907 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-20f21c54-a99e-48ee-8c24-c04d564345e2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for user 406be06d6adf40bbb48d9baf12022988 and project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'key_pairs'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:57:55.948466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-20f21c54-a99e-48ee-8c24-c04d564345e2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069729 Aug 26 08:57:55.952077 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 388/765] 10.222.0.71 () {60 vars in 1159 bytes} [Fri Aug 26 08:57:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:57:56.686874 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-7e6feae2-f297-42a3-967c-0c072019c91a tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:56.687806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-7e6feae2-f297-42a3-967c-0c072019c91a tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:56.695835 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7e6feae2-f297-42a3-967c-0c072019c91a tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:56.696349 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7e6feae2-f297-42a3-967c-0c072019c91a tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:56.696773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7e6feae2-f297-42a3-967c-0c072019c91a tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:56.697491 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7e6feae2-f297-42a3-967c-0c072019c91a tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:56.698161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7e6feae2-f297-42a3-967c-0c072019c91a tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:56.698752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7e6feae2-f297-42a3-967c-0c072019c91a tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:56.880817 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7e6feae2-f297-42a3-967c-0c072019c91a tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:56.891796 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-7e6feae2-f297-42a3-967c-0c072019c91a tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.209222 Aug 26 08:57:56.892851 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 378/766] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:56 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:56.916853 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-bb977c24-8da9-4bb0-a197-e413370ea109 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:56.917885 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-bb977c24-8da9-4bb0-a197-e413370ea109 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:56.928189 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb977c24-8da9-4bb0-a197-e413370ea109 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:56.929096 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb977c24-8da9-4bb0-a197-e413370ea109 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:56.929839 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb977c24-8da9-4bb0-a197-e413370ea109 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:56.931053 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb977c24-8da9-4bb0-a197-e413370ea109 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:56.931799 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb977c24-8da9-4bb0-a197-e413370ea109 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:56.932471 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb977c24-8da9-4bb0-a197-e413370ea109 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:57.025535 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-bb977c24-8da9-4bb0-a197-e413370ea109 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:57.036665 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-bb977c24-8da9-4bb0-a197-e413370ea109 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1289 microversion: 2.1 time: 0.126812 Aug 26 08:57:57.037407 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 389/767] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:56 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1289 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:57.518297 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2007238223", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e1c5bc8-bb18-4879-912d-f9e237efa42e"}], "security_groups": [{"name": "tempest-securitygroup--168025097"}], "key_name": "tempest-keypair-858458509", "user_data": "}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:57.670191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.network.neutron [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] validate_networks() for [('4e1c5bc8-bb18-4879-912d-f9e237efa42e', None, None, None, None, None)] {{(pid=132217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:57:57.924815 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3d38b886-5189-4e82-be6c-35086800a36f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:57.925552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3d38b886-5189-4e82-be6c-35086800a36f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:57.934182 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3d38b886-5189-4e82-be6c-35086800a36f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:57.934667 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3d38b886-5189-4e82-be6c-35086800a36f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:57.935377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3d38b886-5189-4e82-be6c-35086800a36f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:57.936097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3d38b886-5189-4e82-be6c-35086800a36f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:57.936957 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3d38b886-5189-4e82-be6c-35086800a36f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:57.937736 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3d38b886-5189-4e82-be6c-35086800a36f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:58.214589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3d38b886-5189-4e82-be6c-35086800a36f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:58.226716 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3d38b886-5189-4e82-be6c-35086800a36f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.315341 Aug 26 08:57:58.227526 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 390/768] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:57 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:58.234029 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-39824cec-f787-4e74-afc2-92b194cd9c09 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:58.235446 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-39824cec-f787-4e74-afc2-92b194cd9c09 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:58.243685 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-39824cec-f787-4e74-afc2-92b194cd9c09 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:58.244487 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-39824cec-f787-4e74-afc2-92b194cd9c09 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:58.244923 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-39824cec-f787-4e74-afc2-92b194cd9c09 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:58.245647 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-39824cec-f787-4e74-afc2-92b194cd9c09 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:58.246098 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-39824cec-f787-4e74-afc2-92b194cd9c09 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:58.247038 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-39824cec-f787-4e74-afc2-92b194cd9c09 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:58.253118 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:58.307760 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Flavor limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:57:58.308406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Image limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:57:58.309254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Flavor pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:57:58.309891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Image pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:57:58.310655 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:57:58.322569 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:58.323168 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:58.323780 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:58.324816 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:58.325414 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:58.325837 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:58.344589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-39824cec-f787-4e74-afc2-92b194cd9c09 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:58.351674 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:57:58.353729 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-39824cec-f787-4e74-afc2-92b194cd9c09 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1295 microversion: 2.1 time: 0.124964 Aug 26 08:57:58.356618 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for user 406be06d6adf40bbb48d9baf12022988 and project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:57:58.358649 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:58.359419 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 391/769] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:58 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1295 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:58.386637 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Going to run 1 instances... {{(pid=132217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:57:58.389180 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:57:58.436969 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [2c4ff651-d6d4-4667-9735-ed059adacde9] AMQP server on 10.222.0.71:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 26 08:57:59.249514 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f466fac1-f19f-44cb-a353-b01348046613 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:59.250384 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f466fac1-f19f-44cb-a353-b01348046613 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:59.258075 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f466fac1-f19f-44cb-a353-b01348046613 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:59.258646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f466fac1-f19f-44cb-a353-b01348046613 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:59.259215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f466fac1-f19f-44cb-a353-b01348046613 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:59.260010 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f466fac1-f19f-44cb-a353-b01348046613 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:59.260538 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f466fac1-f19f-44cb-a353-b01348046613 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:59.261056 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f466fac1-f19f-44cb-a353-b01348046613 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:59.446802 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO oslo.messaging._drivers.impl_rabbit [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [2c4ff651-d6d4-4667-9735-ed059adacde9] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 57812. Aug 26 08:57:59.452635 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1b8eee3a-9793-4662-8592-657615ef51b6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.939017 Aug 26 08:57:59.462248 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 379/770] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:57:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 08:57:59.462248 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-7ab96302-b5e8-44e2-a2c6-bf943b294c9b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:59.462248 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-7ab96302-b5e8-44e2-a2c6-bf943b294c9b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:59.468786 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7ab96302-b5e8-44e2-a2c6-bf943b294c9b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:59.469316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7ab96302-b5e8-44e2-a2c6-bf943b294c9b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:59.470811 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7ab96302-b5e8-44e2-a2c6-bf943b294c9b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:59.472114 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7ab96302-b5e8-44e2-a2c6-bf943b294c9b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:59.473182 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7ab96302-b5e8-44e2-a2c6-bf943b294c9b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:59.473894 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7ab96302-b5e8-44e2-a2c6-bf943b294c9b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:59.505137 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=100 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:57:59.658727 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7ab96302-b5e8-44e2-a2c6-bf943b294c9b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:59.668328 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f466fac1-f19f-44cb-a353-b01348046613 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:59.671055 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-7ab96302-b5e8-44e2-a2c6-bf943b294c9b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1363 microversion: 2.1 time: 0.215980 Aug 26 08:57:59.671766 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 380/771] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:59 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:59.678683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-633ed57e-d166-4439-a158-c939450a0bf4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:57:59.679833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-633ed57e-d166-4439-a158-c939450a0bf4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:57:59.687620 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f466fac1-f19f-44cb-a353-b01348046613 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.439548 Aug 26 08:57:59.688530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 392/772] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:59 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:59.765560 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-633ed57e-d166-4439-a158-c939450a0bf4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:57:59.784112 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-633ed57e-d166-4439-a158-c939450a0bf4 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1241 microversion: 2.1 time: 0.110846 Aug 26 08:57:59.785432 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 381/773] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:57:59 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:57:59.892320 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-dd07d986-eced-49b0-9c35-d24b9aa97dde req-ed865197-24b0-46ad-b03c-d9c3e75192f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6", "tag": "04af963c-42ee-4251-8552-a695dc2db4de"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:57:59.911671 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-dd07d986-eced-49b0-9c35-d24b9aa97dde req-ed865197-24b0-46ad-b03c-d9c3e75192f4 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:57:59.912383 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-dd07d986-eced-49b0-9c35-d24b9aa97dde req-ed865197-24b0-46ad-b03c-d9c3e75192f4 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:57:59.913871 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-dd07d986-eced-49b0-9c35-d24b9aa97dde req-ed865197-24b0-46ad-b03c-d9c3e75192f4 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:57:59.929195 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-dd07d986-eced-49b0-9c35-d24b9aa97dde req-ed865197-24b0-46ad-b03c-d9c3e75192f4 service nova] Creating event network-changed:04af963c-42ee-4251-8552-a695dc2db4de for instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 on hv-cinder-85236 Aug 26 08:57:59.935950 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-dd07d986-eced-49b0-9c35-d24b9aa97dde req-ed865197-24b0-46ad-b03c-d9c3e75192f4 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056294 Aug 26 08:57:59.937057 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 393/774] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:58:00.696348 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-aa53c08a-940c-46ef-9ad3-c47bf8cdc339 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:00.696961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-aa53c08a-940c-46ef-9ad3-c47bf8cdc339 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:00.704572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aa53c08a-940c-46ef-9ad3-c47bf8cdc339 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:00.705043 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aa53c08a-940c-46ef-9ad3-c47bf8cdc339 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:00.705485 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aa53c08a-940c-46ef-9ad3-c47bf8cdc339 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:00.706172 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aa53c08a-940c-46ef-9ad3-c47bf8cdc339 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:00.706626 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aa53c08a-940c-46ef-9ad3-c47bf8cdc339 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:00.707079 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-aa53c08a-940c-46ef-9ad3-c47bf8cdc339 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:00.714986 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-053447cb-dd9f-4bbf-a38c-a0f010ea256b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:00.716287 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-053447cb-dd9f-4bbf-a38c-a0f010ea256b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:00.723077 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-053447cb-dd9f-4bbf-a38c-a0f010ea256b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:00.723663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-053447cb-dd9f-4bbf-a38c-a0f010ea256b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:00.724125 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-053447cb-dd9f-4bbf-a38c-a0f010ea256b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:00.724863 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-053447cb-dd9f-4bbf-a38c-a0f010ea256b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:00.725318 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-053447cb-dd9f-4bbf-a38c-a0f010ea256b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:00.725742 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-053447cb-dd9f-4bbf-a38c-a0f010ea256b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:00.870274 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-aa53c08a-940c-46ef-9ad3-c47bf8cdc339 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:00.887248 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-aa53c08a-940c-46ef-9ad3-c47bf8cdc339 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1363 microversion: 2.1 time: 0.194743 Aug 26 08:58:00.888041 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 382/775] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:00 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:00.894162 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8ef56357-40a0-498e-a84a-89a70f03b851 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:00.895501 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8ef56357-40a0-498e-a84a-89a70f03b851 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:00.912076 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8ef56357-40a0-498e-a84a-89a70f03b851 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:00.912615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8ef56357-40a0-498e-a84a-89a70f03b851 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:00.913528 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8ef56357-40a0-498e-a84a-89a70f03b851 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:00.914520 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8ef56357-40a0-498e-a84a-89a70f03b851 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:00.915059 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8ef56357-40a0-498e-a84a-89a70f03b851 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:00.915749 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8ef56357-40a0-498e-a84a-89a70f03b851 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:00.930114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-053447cb-dd9f-4bbf-a38c-a0f010ea256b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:00.939982 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-053447cb-dd9f-4bbf-a38c-a0f010ea256b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.229899 Aug 26 08:58:00.940598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 394/776] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:00 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:00.946302 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8ca40ba4-e809-4c43-b3eb-7debe62c7a19 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:58:00.946549 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8ca40ba4-e809-4c43-b3eb-7debe62c7a19 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:00.955349 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8ca40ba4-e809-4c43-b3eb-7debe62c7a19 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:00.956174 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8ca40ba4-e809-4c43-b3eb-7debe62c7a19 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:00.956884 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8ca40ba4-e809-4c43-b3eb-7debe62c7a19 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:00.957986 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8ca40ba4-e809-4c43-b3eb-7debe62c7a19 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:00.958680 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8ca40ba4-e809-4c43-b3eb-7debe62c7a19 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:00.959341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8ca40ba4-e809-4c43-b3eb-7debe62c7a19 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:01.002096 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-8ca40ba4-e809-4c43-b3eb-7debe62c7a19 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lazy-loading 'flavor' on Instance uuid 2b667cb3-d4d2-4c6f-857f-98953e388820 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:58:01.004166 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8ef56357-40a0-498e-a84a-89a70f03b851 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:01.017506 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8ef56357-40a0-498e-a84a-89a70f03b851 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1293 microversion: 2.1 time: 0.127754 Aug 26 08:58:01.018571 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 383/777] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:00 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:01.117114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8ca40ba4-e809-4c43-b3eb-7debe62c7a19 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "POST /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820/action" status: 202 len: 0 microversion: 2.1 time: 0.174717 Aug 26 08:58:01.117898 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 395/778] 10.222.0.71 () {60 vars in 1278 bytes} [Fri Aug 26 08:58:00 2022] POST /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:58:01.129137 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c93cbc83-5ab7-4e17-aa8e-cb1cd15e448f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:01.130118 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c93cbc83-5ab7-4e17-aa8e-cb1cd15e448f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:01.138853 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c93cbc83-5ab7-4e17-aa8e-cb1cd15e448f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:01.139678 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c93cbc83-5ab7-4e17-aa8e-cb1cd15e448f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:01.140353 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c93cbc83-5ab7-4e17-aa8e-cb1cd15e448f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:01.141541 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c93cbc83-5ab7-4e17-aa8e-cb1cd15e448f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:01.142332 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c93cbc83-5ab7-4e17-aa8e-cb1cd15e448f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:01.142996 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c93cbc83-5ab7-4e17-aa8e-cb1cd15e448f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:01.365454 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c93cbc83-5ab7-4e17-aa8e-cb1cd15e448f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:01.379617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c93cbc83-5ab7-4e17-aa8e-cb1cd15e448f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.255823 Aug 26 08:58:01.380290 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 384/779] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:01 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:58:01.922517 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4d01f2c7-ccbe-4a49-8d93-3229a9b06dd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:01.923363 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4d01f2c7-ccbe-4a49-8d93-3229a9b06dd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:01.931388 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4d01f2c7-ccbe-4a49-8d93-3229a9b06dd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:01.931872 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4d01f2c7-ccbe-4a49-8d93-3229a9b06dd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:01.932306 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4d01f2c7-ccbe-4a49-8d93-3229a9b06dd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:01.933184 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4d01f2c7-ccbe-4a49-8d93-3229a9b06dd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:01.933646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4d01f2c7-ccbe-4a49-8d93-3229a9b06dd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:01.934068 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4d01f2c7-ccbe-4a49-8d93-3229a9b06dd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:01.971800 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f99e0a55-569c-4a3d-9924-efce24eb9d9d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:01.972907 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f99e0a55-569c-4a3d-9924-efce24eb9d9d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:01.979296 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f99e0a55-569c-4a3d-9924-efce24eb9d9d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:01.979786 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f99e0a55-569c-4a3d-9924-efce24eb9d9d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:01.980408 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f99e0a55-569c-4a3d-9924-efce24eb9d9d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:01.981186 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f99e0a55-569c-4a3d-9924-efce24eb9d9d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:01.981629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f99e0a55-569c-4a3d-9924-efce24eb9d9d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:01.982039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f99e0a55-569c-4a3d-9924-efce24eb9d9d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:02.170163 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f99e0a55-569c-4a3d-9924-efce24eb9d9d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:02.170536 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4d01f2c7-ccbe-4a49-8d93-3229a9b06dd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:02.179472 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4d01f2c7-ccbe-4a49-8d93-3229a9b06dd0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1363 microversion: 2.1 time: 0.262456 Aug 26 08:58:02.179718 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f99e0a55-569c-4a3d-9924-efce24eb9d9d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.212337 Aug 26 08:58:02.180274 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 385/780] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:01 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:58:02.181767 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 396/781] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:01 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:02.187439 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4556d501-7957-4268-bec7-463b5979aa2b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:02.187966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4556d501-7957-4268-bec7-463b5979aa2b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:02.195748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4556d501-7957-4268-bec7-463b5979aa2b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:02.196394 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4556d501-7957-4268-bec7-463b5979aa2b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:02.197003 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4556d501-7957-4268-bec7-463b5979aa2b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:02.197796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4556d501-7957-4268-bec7-463b5979aa2b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:02.198334 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4556d501-7957-4268-bec7-463b5979aa2b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:02.198842 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4556d501-7957-4268-bec7-463b5979aa2b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:02.272833 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4556d501-7957-4268-bec7-463b5979aa2b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:02.281562 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4556d501-7957-4268-bec7-463b5979aa2b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1293 microversion: 2.1 time: 0.099892 Aug 26 08:58:02.282363 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 397/782] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:02 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:02.402521 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-07fe95c8-8228-40f5-92ae-0dd43d35df0f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:02.403173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-07fe95c8-8228-40f5-92ae-0dd43d35df0f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:02.410151 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-07fe95c8-8228-40f5-92ae-0dd43d35df0f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:02.410650 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-07fe95c8-8228-40f5-92ae-0dd43d35df0f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:02.411131 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-07fe95c8-8228-40f5-92ae-0dd43d35df0f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:02.411840 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-07fe95c8-8228-40f5-92ae-0dd43d35df0f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:02.412267 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-07fe95c8-8228-40f5-92ae-0dd43d35df0f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:02.412693 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-07fe95c8-8228-40f5-92ae-0dd43d35df0f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:02.681474 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-07fe95c8-8228-40f5-92ae-0dd43d35df0f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:02.713220 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-07fe95c8-8228-40f5-92ae-0dd43d35df0f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.314355 Aug 26 08:58:02.714252 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 386/783] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:02 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:03.202533 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2a3d0ad1-3468-49d9-bfca-009a94a056b1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:03.203977 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2a3d0ad1-3468-49d9-bfca-009a94a056b1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:03.208945 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ec9c5a1f-df8b-4c2a-ac42-59959b55a482 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:03.210366 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ec9c5a1f-df8b-4c2a-ac42-59959b55a482 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:03.212861 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a3d0ad1-3468-49d9-bfca-009a94a056b1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:03.213351 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a3d0ad1-3468-49d9-bfca-009a94a056b1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:03.214018 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a3d0ad1-3468-49d9-bfca-009a94a056b1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:03.214743 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a3d0ad1-3468-49d9-bfca-009a94a056b1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:03.215421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a3d0ad1-3468-49d9-bfca-009a94a056b1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:03.215876 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a3d0ad1-3468-49d9-bfca-009a94a056b1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:03.220451 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ec9c5a1f-df8b-4c2a-ac42-59959b55a482 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:03.221158 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ec9c5a1f-df8b-4c2a-ac42-59959b55a482 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:03.222070 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ec9c5a1f-df8b-4c2a-ac42-59959b55a482 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:03.223672 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ec9c5a1f-df8b-4c2a-ac42-59959b55a482 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:03.224643 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ec9c5a1f-df8b-4c2a-ac42-59959b55a482 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:03.225206 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ec9c5a1f-df8b-4c2a-ac42-59959b55a482 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:03.414052 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2a3d0ad1-3468-49d9-bfca-009a94a056b1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:03.426421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2a3d0ad1-3468-49d9-bfca-009a94a056b1 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1758 microversion: 2.1 time: 0.227982 Aug 26 08:58:03.439124 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 398/784] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:03 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1758 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:03.448028 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b2623f27-3aff-49b1-8ed0-bb9926d90474 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:03.449107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b2623f27-3aff-49b1-8ed0-bb9926d90474 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:03.460522 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b2623f27-3aff-49b1-8ed0-bb9926d90474 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:03.461538 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b2623f27-3aff-49b1-8ed0-bb9926d90474 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:03.462172 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b2623f27-3aff-49b1-8ed0-bb9926d90474 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:03.463102 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b2623f27-3aff-49b1-8ed0-bb9926d90474 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:03.463675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b2623f27-3aff-49b1-8ed0-bb9926d90474 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:03.464097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b2623f27-3aff-49b1-8ed0-bb9926d90474 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:03.503196 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ec9c5a1f-df8b-4c2a-ac42-59959b55a482 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:03.519961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ec9c5a1f-df8b-4c2a-ac42-59959b55a482 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1363 microversion: 2.1 time: 0.318111 Aug 26 08:58:03.534126 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 387/785] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:03 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:58:03.550984 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b2623f27-3aff-49b1-8ed0-bb9926d90474 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:03.560435 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b2623f27-3aff-49b1-8ed0-bb9926d90474 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1299 microversion: 2.1 time: 0.119592 Aug 26 08:58:03.561366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 399/786] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:03 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:03.755418 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8b18c736-d6dc-4799-97d6-b53a9f4a00dd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:03.757287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8b18c736-d6dc-4799-97d6-b53a9f4a00dd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:03.767250 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8b18c736-d6dc-4799-97d6-b53a9f4a00dd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:03.768097 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8b18c736-d6dc-4799-97d6-b53a9f4a00dd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:03.769154 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8b18c736-d6dc-4799-97d6-b53a9f4a00dd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:03.770400 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8b18c736-d6dc-4799-97d6-b53a9f4a00dd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:03.771526 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8b18c736-d6dc-4799-97d6-b53a9f4a00dd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:03.772564 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8b18c736-d6dc-4799-97d6-b53a9f4a00dd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:04.047414 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8b18c736-d6dc-4799-97d6-b53a9f4a00dd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:04.060548 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8b18c736-d6dc-4799-97d6-b53a9f4a00dd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.314787 Aug 26 08:58:04.061290 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 388/787] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:03 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:04.452694 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ac91bbe3-fba5-46a4-a018-14f00e5fca52 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:04.453551 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ac91bbe3-fba5-46a4-a018-14f00e5fca52 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:04.461936 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ac91bbe3-fba5-46a4-a018-14f00e5fca52 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:04.462509 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ac91bbe3-fba5-46a4-a018-14f00e5fca52 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:04.462509 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ac91bbe3-fba5-46a4-a018-14f00e5fca52 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:04.464029 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ac91bbe3-fba5-46a4-a018-14f00e5fca52 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:04.464528 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ac91bbe3-fba5-46a4-a018-14f00e5fca52 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:04.464905 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ac91bbe3-fba5-46a4-a018-14f00e5fca52 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:04.547907 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2a238262-9a65-4693-8a22-6c310e998f38 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:04.550229 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2a238262-9a65-4693-8a22-6c310e998f38 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:04.562110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2a238262-9a65-4693-8a22-6c310e998f38 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:04.562803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2a238262-9a65-4693-8a22-6c310e998f38 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:04.563341 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2a238262-9a65-4693-8a22-6c310e998f38 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:04.564268 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2a238262-9a65-4693-8a22-6c310e998f38 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:04.564833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2a238262-9a65-4693-8a22-6c310e998f38 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:04.565327 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2a238262-9a65-4693-8a22-6c310e998f38 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:04.653269 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ac91bbe3-fba5-46a4-a018-14f00e5fca52 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:04.663426 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ac91bbe3-fba5-46a4-a018-14f00e5fca52 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1761 microversion: 2.1 time: 0.215112 Aug 26 08:58:04.664104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 400/788] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:04 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1761 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:04.669305 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5356c2d0-e71e-48db-a13c-601eeed45496 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:04.669968 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5356c2d0-e71e-48db-a13c-601eeed45496 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:04.677562 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5356c2d0-e71e-48db-a13c-601eeed45496 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:04.678432 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5356c2d0-e71e-48db-a13c-601eeed45496 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:04.679072 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5356c2d0-e71e-48db-a13c-601eeed45496 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:04.680189 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5356c2d0-e71e-48db-a13c-601eeed45496 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:04.680352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5356c2d0-e71e-48db-a13c-601eeed45496 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:04.680812 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5356c2d0-e71e-48db-a13c-601eeed45496 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:04.838741 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2a238262-9a65-4693-8a22-6c310e998f38 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:04.850269 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2a238262-9a65-4693-8a22-6c310e998f38 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1363 microversion: 2.1 time: 0.312337 Aug 26 08:58:04.851249 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 389/789] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:04 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:58:04.863198 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-ed61464f-27d5-4d76-bc05-cc46f19358d2 req-c0b52474-1923-440f-afbf-c92fe1b7aaef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0695da3e-654d-4b9d-be68-e195e539e831", "tag": "ce968e83-b42f-4852-8fd6-c16bf4f5b0ee"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:58:04.873025 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-ed61464f-27d5-4d76-bc05-cc46f19358d2 req-c0b52474-1923-440f-afbf-c92fe1b7aaef service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:04.873623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-ed61464f-27d5-4d76-bc05-cc46f19358d2 req-c0b52474-1923-440f-afbf-c92fe1b7aaef service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:04.874586 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-ed61464f-27d5-4d76-bc05-cc46f19358d2 req-c0b52474-1923-440f-afbf-c92fe1b7aaef service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:04.880718 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5356c2d0-e71e-48db-a13c-601eeed45496 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:04.890733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-ed61464f-27d5-4d76-bc05-cc46f19358d2 req-c0b52474-1923-440f-afbf-c92fe1b7aaef service nova] Creating event network-changed:ce968e83-b42f-4852-8fd6-c16bf4f5b0ee for instance 0695da3e-654d-4b9d-be68-e195e539e831 on hv-cinder-85236 Aug 26 08:58:04.891344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5356c2d0-e71e-48db-a13c-601eeed45496 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1366 microversion: 2.1 time: 0.225996 Aug 26 08:58:04.892371 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 401/790] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:04 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:04.899052 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-ed61464f-27d5-4d76-bc05-cc46f19358d2 req-c0b52474-1923-440f-afbf-c92fe1b7aaef service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039285 Aug 26 08:58:04.899052 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 390/791] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:58:05.082229 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-60de7192-2cad-4b9f-b9c0-293b4d4826ad tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:05.082873 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-60de7192-2cad-4b9f-b9c0-293b4d4826ad tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:05.089753 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60de7192-2cad-4b9f-b9c0-293b4d4826ad tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:05.090250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60de7192-2cad-4b9f-b9c0-293b4d4826ad tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:05.090688 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60de7192-2cad-4b9f-b9c0-293b4d4826ad tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:05.091458 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60de7192-2cad-4b9f-b9c0-293b4d4826ad tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:05.091913 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60de7192-2cad-4b9f-b9c0-293b4d4826ad tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:05.093000 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60de7192-2cad-4b9f-b9c0-293b4d4826ad tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:05.267459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-60de7192-2cad-4b9f-b9c0-293b4d4826ad tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:05.277428 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-60de7192-2cad-4b9f-b9c0-293b4d4826ad tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.198502 Aug 26 08:58:05.277428 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 402/792] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:05 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:05.693984 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-748d913a-2940-4ade-a5c1-f5c1c6cd7112 req-6a18841a-3265-43f7-8f9b-ecafb6b884bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6", "name": "network-vif-plugged", "status": "completed", "tag": "04af963c-42ee-4251-8552-a695dc2db4de"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:58:05.706560 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-748d913a-2940-4ade-a5c1-f5c1c6cd7112 req-6a18841a-3265-43f7-8f9b-ecafb6b884bb service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:05.707206 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-748d913a-2940-4ade-a5c1-f5c1c6cd7112 req-6a18841a-3265-43f7-8f9b-ecafb6b884bb service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:05.708174 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-748d913a-2940-4ade-a5c1-f5c1c6cd7112 req-6a18841a-3265-43f7-8f9b-ecafb6b884bb service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:05.722054 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-748d913a-2940-4ade-a5c1-f5c1c6cd7112 req-6a18841a-3265-43f7-8f9b-ecafb6b884bb service nova] Creating event network-vif-plugged:04af963c-42ee-4251-8552-a695dc2db4de for instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 on hv-cinder-85236 Aug 26 08:58:05.729614 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-748d913a-2940-4ade-a5c1-f5c1c6cd7112 req-6a18841a-3265-43f7-8f9b-ecafb6b884bb service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047882 Aug 26 08:58:05.730811 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 391/793] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:58:05.879898 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6278dd08-a057-4f22-b276-dd65cd91faba tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:05.880756 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6278dd08-a057-4f22-b276-dd65cd91faba tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:05.884640 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:05.893412 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6278dd08-a057-4f22-b276-dd65cd91faba tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:05.893987 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6278dd08-a057-4f22-b276-dd65cd91faba tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:05.894615 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6278dd08-a057-4f22-b276-dd65cd91faba tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:05.896108 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6278dd08-a057-4f22-b276-dd65cd91faba tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:05.896658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6278dd08-a057-4f22-b276-dd65cd91faba tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:05.897205 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6278dd08-a057-4f22-b276-dd65cd91faba tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:05.921452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9025ef24-73f7-4e99-80a2-eabefa1d0f8d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:05.922840 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9025ef24-73f7-4e99-80a2-eabefa1d0f8d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:05.937384 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=10 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:05.941340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9025ef24-73f7-4e99-80a2-eabefa1d0f8d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:05.943413 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9025ef24-73f7-4e99-80a2-eabefa1d0f8d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:05.944176 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9025ef24-73f7-4e99-80a2-eabefa1d0f8d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:05.946418 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9025ef24-73f7-4e99-80a2-eabefa1d0f8d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:05.947605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9025ef24-73f7-4e99-80a2-eabefa1d0f8d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:05.948589 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9025ef24-73f7-4e99-80a2-eabefa1d0f8d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:06.158136 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9025ef24-73f7-4e99-80a2-eabefa1d0f8d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:06.175483 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9025ef24-73f7-4e99-80a2-eabefa1d0f8d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1366 microversion: 2.1 time: 0.261522 Aug 26 08:58:06.176588 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 392/794] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:05 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:06.185230 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6278dd08-a057-4f22-b276-dd65cd91faba tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:06.196849 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6278dd08-a057-4f22-b276-dd65cd91faba tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1363 microversion: 2.1 time: 0.321938 Aug 26 08:58:06.196849 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 403/795] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:05 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:06.301149 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8c9baa50-68ec-4d0f-acae-77df5290c9bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:06.301767 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8c9baa50-68ec-4d0f-acae-77df5290c9bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:06.308921 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c9baa50-68ec-4d0f-acae-77df5290c9bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:06.309420 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c9baa50-68ec-4d0f-acae-77df5290c9bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:06.309862 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c9baa50-68ec-4d0f-acae-77df5290c9bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:06.310605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c9baa50-68ec-4d0f-acae-77df5290c9bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:06.311214 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c9baa50-68ec-4d0f-acae-77df5290c9bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:06.311832 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8c9baa50-68ec-4d0f-acae-77df5290c9bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:06.472601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8c9baa50-68ec-4d0f-acae-77df5290c9bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:06.481476 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8c9baa50-68ec-4d0f-acae-77df5290c9bd tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.186412 Aug 26 08:58:06.482084 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 393/796] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:06 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:07.198803 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-90dcca8c-7920-443f-99c6-ba6670a1a524 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:07.199441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-90dcca8c-7920-443f-99c6-ba6670a1a524 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:07.206682 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-90dcca8c-7920-443f-99c6-ba6670a1a524 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:07.207206 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-90dcca8c-7920-443f-99c6-ba6670a1a524 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:07.207686 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-90dcca8c-7920-443f-99c6-ba6670a1a524 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:07.208443 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-90dcca8c-7920-443f-99c6-ba6670a1a524 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:07.208982 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-90dcca8c-7920-443f-99c6-ba6670a1a524 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:07.209404 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-90dcca8c-7920-443f-99c6-ba6670a1a524 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:07.220522 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-7a89cf1c-ab5c-4c66-b091-f1669f3fd07b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:07.221146 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-7a89cf1c-ab5c-4c66-b091-f1669f3fd07b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:07.229406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7a89cf1c-ab5c-4c66-b091-f1669f3fd07b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:07.230179 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7a89cf1c-ab5c-4c66-b091-f1669f3fd07b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:07.230617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7a89cf1c-ab5c-4c66-b091-f1669f3fd07b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:07.231566 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7a89cf1c-ab5c-4c66-b091-f1669f3fd07b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:07.232040 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7a89cf1c-ab5c-4c66-b091-f1669f3fd07b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:07.232477 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7a89cf1c-ab5c-4c66-b091-f1669f3fd07b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:07.405172 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-90dcca8c-7920-443f-99c6-ba6670a1a524 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:07.414184 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-90dcca8c-7920-443f-99c6-ba6670a1a524 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1366 microversion: 2.1 time: 0.219297 Aug 26 08:58:07.414997 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 404/797] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:07 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:58:07.507251 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a331b52e-84b4-4225-b88f-3734a402e96e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:07.507866 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a331b52e-84b4-4225-b88f-3734a402e96e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:07.514654 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a331b52e-84b4-4225-b88f-3734a402e96e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:07.515197 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a331b52e-84b4-4225-b88f-3734a402e96e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:07.515637 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a331b52e-84b4-4225-b88f-3734a402e96e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:07.516358 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a331b52e-84b4-4225-b88f-3734a402e96e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:07.516818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a331b52e-84b4-4225-b88f-3734a402e96e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:07.517229 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a331b52e-84b4-4225-b88f-3734a402e96e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:07.667837 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a331b52e-84b4-4225-b88f-3734a402e96e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:07.677352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a331b52e-84b4-4225-b88f-3734a402e96e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.175003 Aug 26 08:58:07.677575 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-7a89cf1c-ab5c-4c66-b091-f1669f3fd07b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:07.677954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 405/798] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:07 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:58:07.686693 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-7a89cf1c-ab5c-4c66-b091-f1669f3fd07b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1363 microversion: 2.1 time: 0.472562 Aug 26 08:58:07.687570 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 394/799] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:07 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1363 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:58:08.436173 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-60d6e2a2-fe8c-49bf-ab82-bc661a3d6484 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:08.436863 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-60d6e2a2-fe8c-49bf-ab82-bc661a3d6484 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:08.443752 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60d6e2a2-fe8c-49bf-ab82-bc661a3d6484 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:08.444240 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60d6e2a2-fe8c-49bf-ab82-bc661a3d6484 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:08.444665 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60d6e2a2-fe8c-49bf-ab82-bc661a3d6484 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:08.445569 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60d6e2a2-fe8c-49bf-ab82-bc661a3d6484 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:08.446157 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60d6e2a2-fe8c-49bf-ab82-bc661a3d6484 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:08.446719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-60d6e2a2-fe8c-49bf-ab82-bc661a3d6484 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:08.466589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:08.598859 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-60d6e2a2-fe8c-49bf-ab82-bc661a3d6484 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:08.607091 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-60d6e2a2-fe8c-49bf-ab82-bc661a3d6484 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1366 microversion: 2.1 time: 0.174880 Aug 26 08:58:08.608192 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 406/800] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:08 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:08.700204 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9fd127bf-c6d7-41da-a2b6-aa69f252b17f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:08.700817 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9fd127bf-c6d7-41da-a2b6-aa69f252b17f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:08.703471 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:08.711161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9fd127bf-c6d7-41da-a2b6-aa69f252b17f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:08.711858 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9fd127bf-c6d7-41da-a2b6-aa69f252b17f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:08.712387 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9fd127bf-c6d7-41da-a2b6-aa69f252b17f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:08.713515 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9fd127bf-c6d7-41da-a2b6-aa69f252b17f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:08.713697 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-305bba46-a6f7-4d18-acfa-65bcd7f12960 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:08.714314 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9fd127bf-c6d7-41da-a2b6-aa69f252b17f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:08.714687 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-305bba46-a6f7-4d18-acfa-65bcd7f12960 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:08.714966 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9fd127bf-c6d7-41da-a2b6-aa69f252b17f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:08.722521 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-305bba46-a6f7-4d18-acfa-65bcd7f12960 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:08.723080 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-305bba46-a6f7-4d18-acfa-65bcd7f12960 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:08.723501 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-305bba46-a6f7-4d18-acfa-65bcd7f12960 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:08.724288 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-305bba46-a6f7-4d18-acfa-65bcd7f12960 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:08.724796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-305bba46-a6f7-4d18-acfa-65bcd7f12960 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:08.725221 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-305bba46-a6f7-4d18-acfa-65bcd7f12960 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:08.858879 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9fd127bf-c6d7-41da-a2b6-aa69f252b17f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:08.867682 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9fd127bf-c6d7-41da-a2b6-aa69f252b17f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.171381 Aug 26 08:58:08.868293 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 395/801] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:08 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:08.892100 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-305bba46-a6f7-4d18-acfa-65bcd7f12960 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:08.902680 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-305bba46-a6f7-4d18-acfa-65bcd7f12960 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1363 microversion: 2.1 time: 0.195618 Aug 26 08:58:08.903311 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 407/802] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:08 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:58:09.629693 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f77fe056-3f4a-4db7-a355-4b067dbf31d1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:09.630293 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f77fe056-3f4a-4db7-a355-4b067dbf31d1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:09.637206 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f77fe056-3f4a-4db7-a355-4b067dbf31d1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:09.637687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f77fe056-3f4a-4db7-a355-4b067dbf31d1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:09.638109 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f77fe056-3f4a-4db7-a355-4b067dbf31d1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:09.638846 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f77fe056-3f4a-4db7-a355-4b067dbf31d1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:09.639334 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f77fe056-3f4a-4db7-a355-4b067dbf31d1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:09.639757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f77fe056-3f4a-4db7-a355-4b067dbf31d1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:09.781579 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=14 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:09.799408 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f77fe056-3f4a-4db7-a355-4b067dbf31d1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:09.807527 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f77fe056-3f4a-4db7-a355-4b067dbf31d1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1366 microversion: 2.1 time: 0.181750 Aug 26 08:58:09.808406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 396/803] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:09 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:09.902622 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a45b9405-ba3b-49b4-9177-b7accc0ed322 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:09.903485 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a45b9405-ba3b-49b4-9177-b7accc0ed322 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:09.910872 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a45b9405-ba3b-49b4-9177-b7accc0ed322 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:09.911399 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a45b9405-ba3b-49b4-9177-b7accc0ed322 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:09.911840 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a45b9405-ba3b-49b4-9177-b7accc0ed322 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:09.912557 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a45b9405-ba3b-49b4-9177-b7accc0ed322 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:09.913065 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a45b9405-ba3b-49b4-9177-b7accc0ed322 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:09.913416 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a45b9405-ba3b-49b4-9177-b7accc0ed322 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:09.927721 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-36cf7667-ae8d-439c-bb6d-8aadb4dcd10e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:09.928396 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-36cf7667-ae8d-439c-bb6d-8aadb4dcd10e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:09.937606 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-36cf7667-ae8d-439c-bb6d-8aadb4dcd10e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:09.938486 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-36cf7667-ae8d-439c-bb6d-8aadb4dcd10e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:09.939316 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-36cf7667-ae8d-439c-bb6d-8aadb4dcd10e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:09.940539 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-36cf7667-ae8d-439c-bb6d-8aadb4dcd10e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:09.941350 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-36cf7667-ae8d-439c-bb6d-8aadb4dcd10e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:09.942096 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-36cf7667-ae8d-439c-bb6d-8aadb4dcd10e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:10.093043 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a45b9405-ba3b-49b4-9177-b7accc0ed322 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:10.112687 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a45b9405-ba3b-49b4-9177-b7accc0ed322 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.219556 Aug 26 08:58:10.112687 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 408/804] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:09 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:10.179461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-36cf7667-ae8d-439c-bb6d-8aadb4dcd10e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:10.193997 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-36cf7667-ae8d-439c-bb6d-8aadb4dcd10e tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1549 microversion: 2.1 time: 0.270869 Aug 26 08:58:10.194592 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 397/805] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:09 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1549 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:58:10.216883 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4ce38b3c-b677-4a9b-b4f9-341b947d59f7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:10.217379 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4ce38b3c-b677-4a9b-b4f9-341b947d59f7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:10.223899 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ce38b3c-b677-4a9b-b4f9-341b947d59f7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:10.224488 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ce38b3c-b677-4a9b-b4f9-341b947d59f7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:10.225010 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ce38b3c-b677-4a9b-b4f9-341b947d59f7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:10.225823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ce38b3c-b677-4a9b-b4f9-341b947d59f7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:10.226453 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ce38b3c-b677-4a9b-b4f9-341b947d59f7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:10.226829 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ce38b3c-b677-4a9b-b4f9-341b947d59f7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:10.330277 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4ce38b3c-b677-4a9b-b4f9-341b947d59f7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117430 Aug 26 08:58:10.331249 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 409/806] 10.222.0.71 () {58 vars in 1275 bytes} [Fri Aug 26 08:58:10 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:58:10.830254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1e4a4480-2303-44d9-bd7f-c66bd66b03b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:10.831407 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1e4a4480-2303-44d9-bd7f-c66bd66b03b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:10.838515 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1e4a4480-2303-44d9-bd7f-c66bd66b03b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:10.839262 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1e4a4480-2303-44d9-bd7f-c66bd66b03b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:10.839733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1e4a4480-2303-44d9-bd7f-c66bd66b03b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:10.840439 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1e4a4480-2303-44d9-bd7f-c66bd66b03b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:10.840888 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1e4a4480-2303-44d9-bd7f-c66bd66b03b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:10.841299 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1e4a4480-2303-44d9-bd7f-c66bd66b03b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:11.113014 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1e4a4480-2303-44d9-bd7f-c66bd66b03b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:11.127310 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1e4a4480-2303-44d9-bd7f-c66bd66b03b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1366 microversion: 2.1 time: 0.301550 Aug 26 08:58:11.128639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 398/807] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:10 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:11.145115 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6b2b26a0-7bfe-4189-bf9c-cf466ce08fe3 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:11.146173 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6b2b26a0-7bfe-4189-bf9c-cf466ce08fe3 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:11.155699 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b2b26a0-7bfe-4189-bf9c-cf466ce08fe3 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:11.157694 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b2b26a0-7bfe-4189-bf9c-cf466ce08fe3 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:11.157694 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b2b26a0-7bfe-4189-bf9c-cf466ce08fe3 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:11.158588 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b2b26a0-7bfe-4189-bf9c-cf466ce08fe3 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:11.159194 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b2b26a0-7bfe-4189-bf9c-cf466ce08fe3 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:11.159665 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6b2b26a0-7bfe-4189-bf9c-cf466ce08fe3 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:11.328503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6b2b26a0-7bfe-4189-bf9c-cf466ce08fe3 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:11.338666 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6b2b26a0-7bfe-4189-bf9c-cf466ce08fe3 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.200113 Aug 26 08:58:11.339620 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 410/808] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:11 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:11.628034 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-571f7187-f6a5-4410-a6f8-521618e4ece1 req-a9149ad9-cc5b-43a8-8ade-131bc49314ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0695da3e-654d-4b9d-be68-e195e539e831", "name": "network-vif-plugged", "status": "completed", "tag": "ce968e83-b42f-4852-8fd6-c16bf4f5b0ee"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:58:11.636952 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-f7dff79b-e58e-476c-9c8c-f757a42fe80a req-ac6e1697-3dfc-4251-818e-7df38723fceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6", "tag": "04af963c-42ee-4251-8552-a695dc2db4de"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:58:11.653761 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-f7dff79b-e58e-476c-9c8c-f757a42fe80a req-ac6e1697-3dfc-4251-818e-7df38723fceb service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:11.656393 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-571f7187-f6a5-4410-a6f8-521618e4ece1 req-a9149ad9-cc5b-43a8-8ade-131bc49314ce service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:11.657410 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-f7dff79b-e58e-476c-9c8c-f757a42fe80a req-ac6e1697-3dfc-4251-818e-7df38723fceb service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:11.657840 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-f7dff79b-e58e-476c-9c8c-f757a42fe80a req-ac6e1697-3dfc-4251-818e-7df38723fceb service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:11.662818 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-571f7187-f6a5-4410-a6f8-521618e4ece1 req-a9149ad9-cc5b-43a8-8ade-131bc49314ce service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:11.663449 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-571f7187-f6a5-4410-a6f8-521618e4ece1 req-a9149ad9-cc5b-43a8-8ade-131bc49314ce service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:11.676473 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-571f7187-f6a5-4410-a6f8-521618e4ece1 req-a9149ad9-cc5b-43a8-8ade-131bc49314ce service nova] Creating event network-vif-plugged:ce968e83-b42f-4852-8fd6-c16bf4f5b0ee for instance 0695da3e-654d-4b9d-be68-e195e539e831 on hv-cinder-85236 Aug 26 08:58:11.684485 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-571f7187-f6a5-4410-a6f8-521618e4ece1 req-a9149ad9-cc5b-43a8-8ade-131bc49314ce service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065757 Aug 26 08:58:11.685760 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 399/809] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:58:11.686641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-f7dff79b-e58e-476c-9c8c-f757a42fe80a req-ac6e1697-3dfc-4251-818e-7df38723fceb service nova] Creating event network-changed:04af963c-42ee-4251-8552-a695dc2db4de for instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 on hv-cinder-85236 Aug 26 08:58:11.693590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-f7dff79b-e58e-476c-9c8c-f757a42fe80a req-ac6e1697-3dfc-4251-818e-7df38723fceb service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060041 Aug 26 08:58:11.694709 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 411/810] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:58:12.159045 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fb6fb5f9-6a72-4e6c-a354-fb56a2d8aed9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:12.159648 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-fb6fb5f9-6a72-4e6c-a354-fb56a2d8aed9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:12.167664 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb6fb5f9-6a72-4e6c-a354-fb56a2d8aed9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:12.168142 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb6fb5f9-6a72-4e6c-a354-fb56a2d8aed9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:12.168576 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb6fb5f9-6a72-4e6c-a354-fb56a2d8aed9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:12.169291 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb6fb5f9-6a72-4e6c-a354-fb56a2d8aed9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:12.169885 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb6fb5f9-6a72-4e6c-a354-fb56a2d8aed9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:12.170337 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb6fb5f9-6a72-4e6c-a354-fb56a2d8aed9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:12.175348 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=100 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:12.334692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-fb6fb5f9-6a72-4e6c-a354-fb56a2d8aed9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:12.343919 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fb6fb5f9-6a72-4e6c-a354-fb56a2d8aed9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1366 microversion: 2.1 time: 0.189380 Aug 26 08:58:12.344752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 400/811] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:12 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:12.365723 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-67c89678-a524-41b8-ac78-3afb616b37c1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:12.366421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-67c89678-a524-41b8-ac78-3afb616b37c1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:12.379033 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-67c89678-a524-41b8-ac78-3afb616b37c1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:12.379540 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-67c89678-a524-41b8-ac78-3afb616b37c1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:12.379979 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-67c89678-a524-41b8-ac78-3afb616b37c1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:12.380716 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-67c89678-a524-41b8-ac78-3afb616b37c1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:12.381167 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-67c89678-a524-41b8-ac78-3afb616b37c1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:12.381589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-67c89678-a524-41b8-ac78-3afb616b37c1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:12.649831 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-67c89678-a524-41b8-ac78-3afb616b37c1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:12.662604 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-67c89678-a524-41b8-ac78-3afb616b37c1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.300671 Aug 26 08:58:12.671801 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 412/812] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:12 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:13.368571 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fa58d601-a475-40bd-9bda-be84a4ab2267 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:13.369154 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-fa58d601-a475-40bd-9bda-be84a4ab2267 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:13.378214 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa58d601-a475-40bd-9bda-be84a4ab2267 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:13.378713 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa58d601-a475-40bd-9bda-be84a4ab2267 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:13.379188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa58d601-a475-40bd-9bda-be84a4ab2267 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:13.379904 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa58d601-a475-40bd-9bda-be84a4ab2267 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:13.380397 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa58d601-a475-40bd-9bda-be84a4ab2267 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:13.380816 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fa58d601-a475-40bd-9bda-be84a4ab2267 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:13.529218 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-fa58d601-a475-40bd-9bda-be84a4ab2267 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:13.537631 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fa58d601-a475-40bd-9bda-be84a4ab2267 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1366 microversion: 2.1 time: 0.173537 Aug 26 08:58:13.538207 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 401/813] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:13 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:13.685257 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4146a91c-e09c-4142-99ab-f8dabba18f43 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:13.685899 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4146a91c-e09c-4142-99ab-f8dabba18f43 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:13.693156 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4146a91c-e09c-4142-99ab-f8dabba18f43 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:13.693666 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4146a91c-e09c-4142-99ab-f8dabba18f43 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:13.694088 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4146a91c-e09c-4142-99ab-f8dabba18f43 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:13.694780 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4146a91c-e09c-4142-99ab-f8dabba18f43 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:13.695262 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4146a91c-e09c-4142-99ab-f8dabba18f43 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:13.695677 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4146a91c-e09c-4142-99ab-f8dabba18f43 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:13.833220 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4146a91c-e09c-4142-99ab-f8dabba18f43 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:13.841325 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4146a91c-e09c-4142-99ab-f8dabba18f43 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.160149 Aug 26 08:58:13.842009 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 413/814] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:13 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:14.560476 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-bb21b4cf-1fd8-4f4b-b94d-d3f377355b57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:14.561488 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-bb21b4cf-1fd8-4f4b-b94d-d3f377355b57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:14.568768 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bb21b4cf-1fd8-4f4b-b94d-d3f377355b57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:14.569258 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bb21b4cf-1fd8-4f4b-b94d-d3f377355b57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:14.569680 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bb21b4cf-1fd8-4f4b-b94d-d3f377355b57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:14.570377 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bb21b4cf-1fd8-4f4b-b94d-d3f377355b57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:14.570825 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bb21b4cf-1fd8-4f4b-b94d-d3f377355b57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:14.571273 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bb21b4cf-1fd8-4f4b-b94d-d3f377355b57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:14.718113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bb21b4cf-1fd8-4f4b-b94d-d3f377355b57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:14.728430 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-bb21b4cf-1fd8-4f4b-b94d-d3f377355b57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1555 microversion: 2.1 time: 0.174129 Aug 26 08:58:14.729346 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 402/815] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:14 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:14.754960 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c35146f4-3e93-478b-907c-554eee04c006 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:14.755764 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c35146f4-3e93-478b-907c-554eee04c006 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:14.762792 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c35146f4-3e93-478b-907c-554eee04c006 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:14.763309 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c35146f4-3e93-478b-907c-554eee04c006 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:14.763738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c35146f4-3e93-478b-907c-554eee04c006 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:14.764432 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c35146f4-3e93-478b-907c-554eee04c006 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:14.764907 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c35146f4-3e93-478b-907c-554eee04c006 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:14.765325 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c35146f4-3e93-478b-907c-554eee04c006 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:14.849884 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c35146f4-3e93-478b-907c-554eee04c006 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102620 Aug 26 08:58:14.850698 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 414/816] 10.222.0.71 () {58 vars in 1275 bytes} [Fri Aug 26 08:58:14 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:58:14.871829 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-70696127-93cf-4117-84d6-3556dbb59495 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:14.872843 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-70696127-93cf-4117-84d6-3556dbb59495 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:14.880688 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-70696127-93cf-4117-84d6-3556dbb59495 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:14.881170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-70696127-93cf-4117-84d6-3556dbb59495 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:14.881811 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-70696127-93cf-4117-84d6-3556dbb59495 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:14.882685 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-70696127-93cf-4117-84d6-3556dbb59495 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:14.883176 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-70696127-93cf-4117-84d6-3556dbb59495 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:14.883595 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-70696127-93cf-4117-84d6-3556dbb59495 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:15.142486 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-70696127-93cf-4117-84d6-3556dbb59495 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:15.153755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-70696127-93cf-4117-84d6-3556dbb59495 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.287067 Aug 26 08:58:15.154627 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 403/817] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:14 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:16.177101 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a5cf44e3-b556-4554-a53b-22485004185e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:16.177678 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a5cf44e3-b556-4554-a53b-22485004185e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:16.185793 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5cf44e3-b556-4554-a53b-22485004185e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:16.186388 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5cf44e3-b556-4554-a53b-22485004185e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:16.186815 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5cf44e3-b556-4554-a53b-22485004185e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:16.188114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5cf44e3-b556-4554-a53b-22485004185e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:16.188593 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5cf44e3-b556-4554-a53b-22485004185e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:16.189369 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5cf44e3-b556-4554-a53b-22485004185e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:16.218573 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-b41206e5-8030-49b7-a174-c23029a5cfc0 req-ea07a724-eb5a-4179-9422-4d73803ec477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0695da3e-654d-4b9d-be68-e195e539e831", "tag": "ce968e83-b42f-4852-8fd6-c16bf4f5b0ee"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:58:16.231804 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-b41206e5-8030-49b7-a174-c23029a5cfc0 req-ea07a724-eb5a-4179-9422-4d73803ec477 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:16.232480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-b41206e5-8030-49b7-a174-c23029a5cfc0 req-ea07a724-eb5a-4179-9422-4d73803ec477 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:16.232982 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-b41206e5-8030-49b7-a174-c23029a5cfc0 req-ea07a724-eb5a-4179-9422-4d73803ec477 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:16.257105 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-b41206e5-8030-49b7-a174-c23029a5cfc0 req-ea07a724-eb5a-4179-9422-4d73803ec477 service nova] Creating event network-changed:ce968e83-b42f-4852-8fd6-c16bf4f5b0ee for instance 0695da3e-654d-4b9d-be68-e195e539e831 on hv-cinder-85236 Aug 26 08:58:16.263473 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-b41206e5-8030-49b7-a174-c23029a5cfc0 req-ea07a724-eb5a-4179-9422-4d73803ec477 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049083 Aug 26 08:58:16.264196 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 404/818] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:58:16.487314 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a5cf44e3-b556-4554-a53b-22485004185e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:16.497252 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a5cf44e3-b556-4554-a53b-22485004185e tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.325085 Aug 26 08:58:16.497914 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 415/819] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:16 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:17.523173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-41887301-3974-4de4-974d-cc30d670b4a7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:17.523877 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-41887301-3974-4de4-974d-cc30d670b4a7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:17.530824 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-41887301-3974-4de4-974d-cc30d670b4a7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:17.531354 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-41887301-3974-4de4-974d-cc30d670b4a7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:17.531852 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-41887301-3974-4de4-974d-cc30d670b4a7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:17.532546 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-41887301-3974-4de4-974d-cc30d670b4a7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:17.533018 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-41887301-3974-4de4-974d-cc30d670b4a7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:17.533436 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-41887301-3974-4de4-974d-cc30d670b4a7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:17.683767 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-41887301-3974-4de4-974d-cc30d670b4a7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:17.692806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-41887301-3974-4de4-974d-cc30d670b4a7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.174666 Aug 26 08:58:17.693384 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 405/820] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:17 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:18.715429 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2a03efaf-913a-48a3-aba6-be2ffaa20622 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:18.716092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2a03efaf-913a-48a3-aba6-be2ffaa20622 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:18.723789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a03efaf-913a-48a3-aba6-be2ffaa20622 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:18.724288 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a03efaf-913a-48a3-aba6-be2ffaa20622 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:18.724724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a03efaf-913a-48a3-aba6-be2ffaa20622 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:18.725453 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a03efaf-913a-48a3-aba6-be2ffaa20622 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:18.726024 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a03efaf-913a-48a3-aba6-be2ffaa20622 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:18.726508 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a03efaf-913a-48a3-aba6-be2ffaa20622 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:18.870148 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2a03efaf-913a-48a3-aba6-be2ffaa20622 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:18.878864 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2a03efaf-913a-48a3-aba6-be2ffaa20622 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.167557 Aug 26 08:58:18.879497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 416/821] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:18 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:19.902568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-28bf7ac4-d4c9-4bfd-a108-a6d83ff5a944 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:19.903218 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-28bf7ac4-d4c9-4bfd-a108-a6d83ff5a944 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:19.913008 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-28bf7ac4-d4c9-4bfd-a108-a6d83ff5a944 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:19.913008 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-28bf7ac4-d4c9-4bfd-a108-a6d83ff5a944 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:19.913008 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-28bf7ac4-d4c9-4bfd-a108-a6d83ff5a944 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:19.913008 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-28bf7ac4-d4c9-4bfd-a108-a6d83ff5a944 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:19.913479 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-28bf7ac4-d4c9-4bfd-a108-a6d83ff5a944 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:19.913686 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-28bf7ac4-d4c9-4bfd-a108-a6d83ff5a944 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:20.053570 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-28bf7ac4-d4c9-4bfd-a108-a6d83ff5a944 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:20.063185 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-28bf7ac4-d4c9-4bfd-a108-a6d83ff5a944 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.165776 Aug 26 08:58:20.063451 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 406/822] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:19 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:21.084731 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-617eb165-501f-4ecc-afa1-e370b7e99ade tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:21.085383 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-617eb165-501f-4ecc-afa1-e370b7e99ade tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:21.093766 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-617eb165-501f-4ecc-afa1-e370b7e99ade tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:21.094487 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-617eb165-501f-4ecc-afa1-e370b7e99ade tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:21.095115 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-617eb165-501f-4ecc-afa1-e370b7e99ade tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:21.095968 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-617eb165-501f-4ecc-afa1-e370b7e99ade tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:21.096555 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-617eb165-501f-4ecc-afa1-e370b7e99ade tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:21.096982 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-617eb165-501f-4ecc-afa1-e370b7e99ade tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:21.254856 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-617eb165-501f-4ecc-afa1-e370b7e99ade tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:21.263198 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-617eb165-501f-4ecc-afa1-e370b7e99ade tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1572 microversion: 2.1 time: 0.182405 Aug 26 08:58:21.263779 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 417/823] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:21 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1572 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:21.284827 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-56180a00-a466-45ee-a0bf-d4df7d89de78 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:58:21.285474 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-56180a00-a466-45ee-a0bf-d4df7d89de78 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:21.292223 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-56180a00-a466-45ee-a0bf-d4df7d89de78 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:21.292731 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-56180a00-a466-45ee-a0bf-d4df7d89de78 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:21.293145 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-56180a00-a466-45ee-a0bf-d4df7d89de78 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:21.294048 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-56180a00-a466-45ee-a0bf-d4df7d89de78 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:21.294503 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-56180a00-a466-45ee-a0bf-d4df7d89de78 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:21.294922 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-56180a00-a466-45ee-a0bf-d4df7d89de78 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:21.328157 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-56180a00-a466-45ee-a0bf-d4df7d89de78 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132217) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 08:58:21.404252 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-56180a00-a466-45ee-a0bf-d4df7d89de78 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "POST /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820/action" status: 202 len: 0 microversion: 2.1 time: 0.123266 Aug 26 08:58:21.409183 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 407/824] 10.222.0.71 () {60 vars in 1278 bytes} [Fri Aug 26 08:58:21 2022] POST /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:58:21.417765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9424bc58-cbe9-436c-bb4d-c016f16f5306 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:21.418851 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9424bc58-cbe9-436c-bb4d-c016f16f5306 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:21.428357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9424bc58-cbe9-436c-bb4d-c016f16f5306 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:21.428849 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9424bc58-cbe9-436c-bb4d-c016f16f5306 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:21.429302 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9424bc58-cbe9-436c-bb4d-c016f16f5306 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:21.430049 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9424bc58-cbe9-436c-bb4d-c016f16f5306 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:21.430509 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9424bc58-cbe9-436c-bb4d-c016f16f5306 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:21.430993 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9424bc58-cbe9-436c-bb4d-c016f16f5306 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:21.634996 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9424bc58-cbe9-436c-bb4d-c016f16f5306 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:21.643323 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9424bc58-cbe9-436c-bb4d-c016f16f5306 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1520 microversion: 2.1 time: 0.232159 Aug 26 08:58:21.643899 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 418/825] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:21 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:22.668112 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-af810937-c134-4077-a3fe-c149a0864885 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:22.668796 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-af810937-c134-4077-a3fe-c149a0864885 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:22.675698 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-af810937-c134-4077-a3fe-c149a0864885 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:22.676189 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-af810937-c134-4077-a3fe-c149a0864885 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:22.676615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-af810937-c134-4077-a3fe-c149a0864885 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:22.677330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-af810937-c134-4077-a3fe-c149a0864885 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:22.677782 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-af810937-c134-4077-a3fe-c149a0864885 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:22.678199 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-af810937-c134-4077-a3fe-c149a0864885 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:22.826556 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-af810937-c134-4077-a3fe-c149a0864885 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:22.836657 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-af810937-c134-4077-a3fe-c149a0864885 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1522 microversion: 2.1 time: 0.174971 Aug 26 08:58:22.837270 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 408/826] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:22 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:23.530587 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-8e1deb90-ac9c-4486-ba63-1b8412af9ca4 req-ef3622b3-d3cb-43ca-b19d-f9e93c6f4efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b667cb3-d4d2-4c6f-857f-98953e388820", "name": "network-vif-unplugged", "status": "completed", "tag": "3a68c7ab-a856-4f62-ace7-5a4ee528bca2"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:58:23.540901 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-8e1deb90-ac9c-4486-ba63-1b8412af9ca4 req-ef3622b3-d3cb-43ca-b19d-f9e93c6f4efa service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:23.541477 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-8e1deb90-ac9c-4486-ba63-1b8412af9ca4 req-ef3622b3-d3cb-43ca-b19d-f9e93c6f4efa service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:23.541953 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-8e1deb90-ac9c-4486-ba63-1b8412af9ca4 req-ef3622b3-d3cb-43ca-b19d-f9e93c6f4efa service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:23.554984 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-8e1deb90-ac9c-4486-ba63-1b8412af9ca4 req-ef3622b3-d3cb-43ca-b19d-f9e93c6f4efa service nova] Creating event network-vif-unplugged:3a68c7ab-a856-4f62-ace7-5a4ee528bca2 for instance 2b667cb3-d4d2-4c6f-857f-98953e388820 on hv-cinder-85236 Aug 26 08:58:23.560221 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-8e1deb90-ac9c-4486-ba63-1b8412af9ca4 req-ef3622b3-d3cb-43ca-b19d-f9e93c6f4efa service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033524 Aug 26 08:58:23.560763 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 419/827] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:58:23.858434 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-85b71bda-aa6e-40f8-812d-89a2e69448b7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:23.859244 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-85b71bda-aa6e-40f8-812d-89a2e69448b7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:23.865954 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-85b71bda-aa6e-40f8-812d-89a2e69448b7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:23.866433 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-85b71bda-aa6e-40f8-812d-89a2e69448b7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:23.866857 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-85b71bda-aa6e-40f8-812d-89a2e69448b7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:23.867607 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-85b71bda-aa6e-40f8-812d-89a2e69448b7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:23.868053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-85b71bda-aa6e-40f8-812d-89a2e69448b7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:23.868459 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-85b71bda-aa6e-40f8-812d-89a2e69448b7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:24.007927 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-85b71bda-aa6e-40f8-812d-89a2e69448b7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:24.019287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-85b71bda-aa6e-40f8-812d-89a2e69448b7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1578 microversion: 2.1 time: 0.164747 Aug 26 08:58:24.019887 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 409/828] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:23 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:25.042472 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ca9fd4a1-9315-4dca-84a4-ba994c7ea558 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:25.043159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ca9fd4a1-9315-4dca-84a4-ba994c7ea558 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:25.050171 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca9fd4a1-9315-4dca-84a4-ba994c7ea558 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:25.050700 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca9fd4a1-9315-4dca-84a4-ba994c7ea558 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:25.051163 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca9fd4a1-9315-4dca-84a4-ba994c7ea558 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:25.051863 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca9fd4a1-9315-4dca-84a4-ba994c7ea558 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:25.052318 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca9fd4a1-9315-4dca-84a4-ba994c7ea558 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:25.052733 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca9fd4a1-9315-4dca-84a4-ba994c7ea558 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:25.206531 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ca9fd4a1-9315-4dca-84a4-ba994c7ea558 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:25.215224 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ca9fd4a1-9315-4dca-84a4-ba994c7ea558 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1578 microversion: 2.1 time: 0.177705 Aug 26 08:58:25.215781 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 420/829] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:25 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:26.238519 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-859777bc-d9ce-44dd-bd45-87e047be428b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:26.239192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-859777bc-d9ce-44dd-bd45-87e047be428b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:26.246370 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-859777bc-d9ce-44dd-bd45-87e047be428b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:26.246756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-859777bc-d9ce-44dd-bd45-87e047be428b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:26.247234 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-859777bc-d9ce-44dd-bd45-87e047be428b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:26.247911 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-859777bc-d9ce-44dd-bd45-87e047be428b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:26.248691 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-859777bc-d9ce-44dd-bd45-87e047be428b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:26.248880 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-859777bc-d9ce-44dd-bd45-87e047be428b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:26.385732 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-859777bc-d9ce-44dd-bd45-87e047be428b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:26.394325 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-859777bc-d9ce-44dd-bd45-87e047be428b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1578 microversion: 2.1 time: 0.159932 Aug 26 08:58:26.394928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 410/830] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:26 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:27.415874 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4ae7355f-dbd7-4968-8657-2cb2e379658a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:27.416472 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4ae7355f-dbd7-4968-8657-2cb2e379658a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:27.419138 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:27.428284 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ae7355f-dbd7-4968-8657-2cb2e379658a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:27.428983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ae7355f-dbd7-4968-8657-2cb2e379658a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:27.430505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ae7355f-dbd7-4968-8657-2cb2e379658a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:27.430686 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ae7355f-dbd7-4968-8657-2cb2e379658a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:27.431332 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ae7355f-dbd7-4968-8657-2cb2e379658a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:27.431743 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4ae7355f-dbd7-4968-8657-2cb2e379658a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:27.599643 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4ae7355f-dbd7-4968-8657-2cb2e379658a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:27.607976 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4ae7355f-dbd7-4968-8657-2cb2e379658a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1578 microversion: 2.1 time: 0.196165 Aug 26 08:58:27.608551 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 421/831] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:27 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1578 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:28.630202 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d780eb22-783e-4a27-9846-21a59eaaa956 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:28.630807 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d780eb22-783e-4a27-9846-21a59eaaa956 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:28.633289 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:28.640673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d780eb22-783e-4a27-9846-21a59eaaa956 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:28.641303 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d780eb22-783e-4a27-9846-21a59eaaa956 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:28.641867 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d780eb22-783e-4a27-9846-21a59eaaa956 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:28.643015 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d780eb22-783e-4a27-9846-21a59eaaa956 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:28.643625 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d780eb22-783e-4a27-9846-21a59eaaa956 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:28.644195 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d780eb22-783e-4a27-9846-21a59eaaa956 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:28.791448 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d780eb22-783e-4a27-9846-21a59eaaa956 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:28.799649 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d780eb22-783e-4a27-9846-21a59eaaa956 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1578 microversion: 2.1 time: 0.173640 Aug 26 08:58:28.800231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 411/832] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:28 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:29.824132 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-bb1a416f-a0ab-4b5a-a721-73919490dd67 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:29.824796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-bb1a416f-a0ab-4b5a-a721-73919490dd67 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:29.832519 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb1a416f-a0ab-4b5a-a721-73919490dd67 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:29.833158 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb1a416f-a0ab-4b5a-a721-73919490dd67 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:29.833585 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb1a416f-a0ab-4b5a-a721-73919490dd67 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:29.834366 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb1a416f-a0ab-4b5a-a721-73919490dd67 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:29.834911 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb1a416f-a0ab-4b5a-a721-73919490dd67 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:29.835354 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bb1a416f-a0ab-4b5a-a721-73919490dd67 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:29.988556 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-bb1a416f-a0ab-4b5a-a721-73919490dd67 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:29.996940 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-bb1a416f-a0ab-4b5a-a721-73919490dd67 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1578 microversion: 2.1 time: 0.179176 Aug 26 08:58:29.997514 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 422/833] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:29 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1578 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:31.018879 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e3e472e8-b6de-478e-979a-e347e0a7b4a4 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:31.019537 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e3e472e8-b6de-478e-979a-e347e0a7b4a4 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:31.026869 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e3e472e8-b6de-478e-979a-e347e0a7b4a4 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:31.027380 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e3e472e8-b6de-478e-979a-e347e0a7b4a4 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:31.027809 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e3e472e8-b6de-478e-979a-e347e0a7b4a4 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:31.028494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e3e472e8-b6de-478e-979a-e347e0a7b4a4 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:31.028951 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e3e472e8-b6de-478e-979a-e347e0a7b4a4 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:31.029369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e3e472e8-b6de-478e-979a-e347e0a7b4a4 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:31.171004 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e3e472e8-b6de-478e-979a-e347e0a7b4a4 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:31.179440 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e3e472e8-b6de-478e-979a-e347e0a7b4a4 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1578 microversion: 2.1 time: 0.164521 Aug 26 08:58:31.180044 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 412/834] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:31 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:32.203843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-add7589e-351b-464e-94ff-ce1b96753467 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:32.204484 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-add7589e-351b-464e-94ff-ce1b96753467 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:32.213343 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-add7589e-351b-464e-94ff-ce1b96753467 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:32.213833 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-add7589e-351b-464e-94ff-ce1b96753467 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:32.214264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-add7589e-351b-464e-94ff-ce1b96753467 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:32.215002 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-add7589e-351b-464e-94ff-ce1b96753467 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:32.215459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-add7589e-351b-464e-94ff-ce1b96753467 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:32.215881 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-add7589e-351b-464e-94ff-ce1b96753467 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:32.368084 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-add7589e-351b-464e-94ff-ce1b96753467 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:32.377088 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-add7589e-351b-464e-94ff-ce1b96753467 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1578 microversion: 2.1 time: 0.179565 Aug 26 08:58:32.377696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 423/835] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:32 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1578 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:58:33.399807 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c9787584-c8ef-4c7a-90f6-6c5cdd8d358b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:33.400543 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c9787584-c8ef-4c7a-90f6-6c5cdd8d358b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:33.407280 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c9787584-c8ef-4c7a-90f6-6c5cdd8d358b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:33.407778 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c9787584-c8ef-4c7a-90f6-6c5cdd8d358b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:33.408218 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c9787584-c8ef-4c7a-90f6-6c5cdd8d358b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:33.408928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c9787584-c8ef-4c7a-90f6-6c5cdd8d358b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:33.409440 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c9787584-c8ef-4c7a-90f6-6c5cdd8d358b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:33.409857 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c9787584-c8ef-4c7a-90f6-6c5cdd8d358b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:33.573138 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c9787584-c8ef-4c7a-90f6-6c5cdd8d358b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:33.586542 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c9787584-c8ef-4c7a-90f6-6c5cdd8d358b tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1578 microversion: 2.1 time: 0.191753 Aug 26 08:58:33.598915 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 413/836] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:33 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1578 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:34.610942 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a116e534-1b20-40e7-9ce1-94a31dd3e577 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:34.611595 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a116e534-1b20-40e7-9ce1-94a31dd3e577 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:34.618406 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a116e534-1b20-40e7-9ce1-94a31dd3e577 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:34.618911 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a116e534-1b20-40e7-9ce1-94a31dd3e577 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:34.619340 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a116e534-1b20-40e7-9ce1-94a31dd3e577 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:34.620041 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a116e534-1b20-40e7-9ce1-94a31dd3e577 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:34.620480 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a116e534-1b20-40e7-9ce1-94a31dd3e577 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:34.620889 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a116e534-1b20-40e7-9ce1-94a31dd3e577 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:35.060719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a116e534-1b20-40e7-9ce1-94a31dd3e577 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:35.069692 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a116e534-1b20-40e7-9ce1-94a31dd3e577 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1578 microversion: 2.1 time: 0.463064 Aug 26 08:58:35.070311 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 424/837] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:34 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1578 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:35.832487 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-0bb2d65b-6010-4322-874b-b9864c9c062f req-6ae81398-75d8-43cf-997e-0b3134b76e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b667cb3-d4d2-4c6f-857f-98953e388820", "name": "network-vif-plugged", "status": "completed", "tag": "3a68c7ab-a856-4f62-ace7-5a4ee528bca2"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:58:35.843119 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-0bb2d65b-6010-4322-874b-b9864c9c062f req-6ae81398-75d8-43cf-997e-0b3134b76e7b service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:35.843629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-0bb2d65b-6010-4322-874b-b9864c9c062f req-6ae81398-75d8-43cf-997e-0b3134b76e7b service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:35.844049 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-0bb2d65b-6010-4322-874b-b9864c9c062f req-6ae81398-75d8-43cf-997e-0b3134b76e7b service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:35.856584 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-0bb2d65b-6010-4322-874b-b9864c9c062f req-6ae81398-75d8-43cf-997e-0b3134b76e7b service nova] Creating event network-vif-plugged:3a68c7ab-a856-4f62-ace7-5a4ee528bca2 for instance 2b667cb3-d4d2-4c6f-857f-98953e388820 on hv-cinder-85236 Aug 26 08:58:35.862009 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-0bb2d65b-6010-4322-874b-b9864c9c062f req-6ae81398-75d8-43cf-997e-0b3134b76e7b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033188 Aug 26 08:58:35.862612 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 414/838] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:58:36.094386 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-89107f39-4c1e-4b05-b2f9-1414e864264c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:36.095026 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-89107f39-4c1e-4b05-b2f9-1414e864264c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:36.101925 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-89107f39-4c1e-4b05-b2f9-1414e864264c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:36.102421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-89107f39-4c1e-4b05-b2f9-1414e864264c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:36.102853 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-89107f39-4c1e-4b05-b2f9-1414e864264c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:36.103593 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-89107f39-4c1e-4b05-b2f9-1414e864264c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:36.104203 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-89107f39-4c1e-4b05-b2f9-1414e864264c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:36.104629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-89107f39-4c1e-4b05-b2f9-1414e864264c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:36.110225 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=100 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:36.293072 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-89107f39-4c1e-4b05-b2f9-1414e864264c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:36.301467 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-89107f39-4c1e-4b05-b2f9-1414e864264c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1578 microversion: 2.1 time: 0.212993 Aug 26 08:58:36.302068 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 425/839] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:36 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1578 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:37.323154 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fd857e00-9391-423f-a968-5dfe4f1fdae7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:37.323838 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-fd857e00-9391-423f-a968-5dfe4f1fdae7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:37.330680 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fd857e00-9391-423f-a968-5dfe4f1fdae7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:37.331167 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fd857e00-9391-423f-a968-5dfe4f1fdae7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:37.331603 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fd857e00-9391-423f-a968-5dfe4f1fdae7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:37.332327 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fd857e00-9391-423f-a968-5dfe4f1fdae7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:37.332777 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fd857e00-9391-423f-a968-5dfe4f1fdae7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:37.333202 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fd857e00-9391-423f-a968-5dfe4f1fdae7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:37.471439 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-fd857e00-9391-423f-a968-5dfe4f1fdae7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:37.479759 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fd857e00-9391-423f-a968-5dfe4f1fdae7 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1578 microversion: 2.1 time: 0.161505 Aug 26 08:58:37.480323 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 415/840] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:37 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:38.509274 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9bb4c48c-06b2-40d8-948d-d1d1fb7081ce tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:38.510174 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9bb4c48c-06b2-40d8-948d-d1d1fb7081ce tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:38.518002 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9bb4c48c-06b2-40d8-948d-d1d1fb7081ce tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:38.518492 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9bb4c48c-06b2-40d8-948d-d1d1fb7081ce tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:38.518924 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9bb4c48c-06b2-40d8-948d-d1d1fb7081ce tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:38.519659 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9bb4c48c-06b2-40d8-948d-d1d1fb7081ce tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:38.520113 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9bb4c48c-06b2-40d8-948d-d1d1fb7081ce tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:38.520528 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9bb4c48c-06b2-40d8-948d-d1d1fb7081ce tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:38.676954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9bb4c48c-06b2-40d8-948d-d1d1fb7081ce tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:38.686044 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9bb4c48c-06b2-40d8-948d-d1d1fb7081ce tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1565 microversion: 2.1 time: 0.182953 Aug 26 08:58:38.686637 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 426/841] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:38 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:46.848891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0d392109-290f-4f84-a2e7-6e068d1607d4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:46.849509 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-0d392109-290f-4f84-a2e7-6e068d1607d4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:46.856560 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0d392109-290f-4f84-a2e7-6e068d1607d4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:46.857027 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0d392109-290f-4f84-a2e7-6e068d1607d4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:46.857484 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0d392109-290f-4f84-a2e7-6e068d1607d4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:46.858184 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0d392109-290f-4f84-a2e7-6e068d1607d4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:46.858631 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0d392109-290f-4f84-a2e7-6e068d1607d4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:46.859176 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0d392109-290f-4f84-a2e7-6e068d1607d4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:46.861693 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:46.884920 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-0d392109-290f-4f84-a2e7-6e068d1607d4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b/ips" status: 200 len: 151 microversion: 2.20 time: 0.040065 Aug 26 08:58:46.885496 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 416/842] 10.222.0.71 () {60 vars in 1289 bytes} [Fri Aug 26 08:58:46 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:58:47.052791 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0f992492-fe15-4cf6-a8c1-361ecca75c25 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:47.053411 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0f992492-fe15-4cf6-a8c1-361ecca75c25 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:47.060968 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f992492-fe15-4cf6-a8c1-361ecca75c25 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:47.061835 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f992492-fe15-4cf6-a8c1-361ecca75c25 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:47.061835 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f992492-fe15-4cf6-a8c1-361ecca75c25 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:47.062559 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f992492-fe15-4cf6-a8c1-361ecca75c25 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:47.063033 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f992492-fe15-4cf6-a8c1-361ecca75c25 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:47.063465 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0f992492-fe15-4cf6-a8c1-361ecca75c25 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:47.167414 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-0f992492-fe15-4cf6-a8c1-361ecca75c25 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lazy-loading 'services' on Instance uuid 1704235c-9819-4980-9ee0-b46ecd91de2e {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:58:47.248421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0f992492-fe15-4cf6-a8c1-361ecca75c25 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "DELETE /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-volume_attachments/e182deb0-7571-4634-bddb-118bf51b22b3" status: 202 len: 0 microversion: 2.1 time: 0.199951 Aug 26 08:58:47.249029 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 427/843] 10.222.0.71 () {58 vars in 1416 bytes} [Fri Aug 26 08:58:47 2022] DELETE /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-volume_attachments/e182deb0-7571-4634-bddb-118bf51b22b3 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:58:47.258233 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9a7d5388-2a4b-4e66-8fbf-172cd686af9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:47.260431 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9a7d5388-2a4b-4e66-8fbf-172cd686af9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:47.267336 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a7d5388-2a4b-4e66-8fbf-172cd686af9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:47.267831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a7d5388-2a4b-4e66-8fbf-172cd686af9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:47.268271 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a7d5388-2a4b-4e66-8fbf-172cd686af9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:47.269062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a7d5388-2a4b-4e66-8fbf-172cd686af9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:47.269484 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a7d5388-2a4b-4e66-8fbf-172cd686af9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:47.269873 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a7d5388-2a4b-4e66-8fbf-172cd686af9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:47.305358 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9a7d5388-2a4b-4e66-8fbf-172cd686af9c tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051172 Aug 26 08:58:47.306030 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 417/844] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:58:47 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:58:48.321733 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c5345583-88fa-4f55-b820-1da9efa24fd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:48.324651 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c5345583-88fa-4f55-b820-1da9efa24fd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:48.332588 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c5345583-88fa-4f55-b820-1da9efa24fd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:48.333156 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c5345583-88fa-4f55-b820-1da9efa24fd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:48.333580 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c5345583-88fa-4f55-b820-1da9efa24fd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:48.334583 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c5345583-88fa-4f55-b820-1da9efa24fd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:48.335241 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c5345583-88fa-4f55-b820-1da9efa24fd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:48.335814 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c5345583-88fa-4f55-b820-1da9efa24fd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:48.371588 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c5345583-88fa-4f55-b820-1da9efa24fd4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055886 Aug 26 08:58:48.372522 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 428/845] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:58:48 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:58:49.214274 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fcada189-5b8a-431e-9331-10e8125c006b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:58:49.214784 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-fcada189-5b8a-431e-9331-10e8125c006b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:49.221480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fcada189-5b8a-431e-9331-10e8125c006b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:49.221961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fcada189-5b8a-431e-9331-10e8125c006b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:49.222383 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fcada189-5b8a-431e-9331-10e8125c006b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:49.223115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fcada189-5b8a-431e-9331-10e8125c006b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:49.223572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fcada189-5b8a-431e-9331-10e8125c006b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:49.223986 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fcada189-5b8a-431e-9331-10e8125c006b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:49.248693 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-fcada189-5b8a-431e-9331-10e8125c006b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lazy-loading 'flavor' on Instance uuid cbfe1e03-de30-4198-9a4d-a96708dbb98b {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:58:49.387536 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f7f9ed80-a0b5-47be-ad93-1cf52a62fdeb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:49.389950 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f7f9ed80-a0b5-47be-ad93-1cf52a62fdeb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:49.397015 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f7f9ed80-a0b5-47be-ad93-1cf52a62fdeb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:49.397509 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f7f9ed80-a0b5-47be-ad93-1cf52a62fdeb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:49.397937 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f7f9ed80-a0b5-47be-ad93-1cf52a62fdeb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:49.398641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f7f9ed80-a0b5-47be-ad93-1cf52a62fdeb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:49.399130 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f7f9ed80-a0b5-47be-ad93-1cf52a62fdeb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:49.400382 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f7f9ed80-a0b5-47be-ad93-1cf52a62fdeb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:49.432847 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f7f9ed80-a0b5-47be-ad93-1cf52a62fdeb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049425 Aug 26 08:58:49.433627 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 429/846] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:58:49 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 08:58:49.456733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fcada189-5b8a-431e-9331-10e8125c006b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "POST /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b/action" status: 202 len: 0 microversion: 2.20 time: 0.247677 Aug 26 08:58:49.457480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 418/847] 10.222.0.71 () {62 vars in 1319 bytes} [Fri Aug 26 08:58:49 2022] POST /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:58:49.466124 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-86a8903d-a830-4e3d-bde7-67155accd2db tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:49.466771 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-86a8903d-a830-4e3d-bde7-67155accd2db tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:49.473151 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-86a8903d-a830-4e3d-bde7-67155accd2db tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:49.473662 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-86a8903d-a830-4e3d-bde7-67155accd2db tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:49.474109 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-86a8903d-a830-4e3d-bde7-67155accd2db tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:49.474799 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-86a8903d-a830-4e3d-bde7-67155accd2db tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:49.475285 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-86a8903d-a830-4e3d-bde7-67155accd2db tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:49.475709 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-86a8903d-a830-4e3d-bde7-67155accd2db tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:49.522123 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2328d48a-ea27-45ed-a158-344199845728 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:49.522785 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2328d48a-ea27-45ed-a158-344199845728 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:49.529902 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2328d48a-ea27-45ed-a158-344199845728 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:49.530469 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2328d48a-ea27-45ed-a158-344199845728 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:49.531035 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2328d48a-ea27-45ed-a158-344199845728 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:49.531789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2328d48a-ea27-45ed-a158-344199845728 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:49.532830 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2328d48a-ea27-45ed-a158-344199845728 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:49.532830 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2328d48a-ea27-45ed-a158-344199845728 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:49.559176 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2328d48a-ea27-45ed-a158-344199845728 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Going to try to terminate instance {{(pid=132217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 08:58:49.619497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-86a8903d-a830-4e3d-bde7-67155accd2db tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:49.630408 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-86a8903d-a830-4e3d-bde7-67155accd2db tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:49.631909 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-86a8903d-a830-4e3d-bde7-67155accd2db tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:49.633137 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-86a8903d-a830-4e3d-bde7-67155accd2db tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.171106 Aug 26 08:58:49.633692 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 430/848] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:58:49 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:58:49.642311 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2328d48a-ea27-45ed-a158-344199845728 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "DELETE /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 204 len: 0 microversion: 2.1 time: 0.131463 Aug 26 08:58:49.642939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 419/849] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 08:58:49 2022] DELETE /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:58:49.651709 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-bdcfb4e4-9711-4167-8660-e0bc377c1cf4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:49.652452 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-bdcfb4e4-9711-4167-8660-e0bc377c1cf4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:49.659861 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bdcfb4e4-9711-4167-8660-e0bc377c1cf4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:49.660345 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bdcfb4e4-9711-4167-8660-e0bc377c1cf4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:49.660781 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bdcfb4e4-9711-4167-8660-e0bc377c1cf4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:49.661475 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bdcfb4e4-9711-4167-8660-e0bc377c1cf4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:49.661919 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bdcfb4e4-9711-4167-8660-e0bc377c1cf4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:49.662333 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bdcfb4e4-9711-4167-8660-e0bc377c1cf4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:49.801694 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-bdcfb4e4-9711-4167-8660-e0bc377c1cf4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:49.813217 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-bdcfb4e4-9711-4167-8660-e0bc377c1cf4 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1690 microversion: 2.1 time: 0.166050 Aug 26 08:58:49.813807 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 431/850] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:49 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:50.657727 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1fb7449a-dc5a-4596-9f99-b629fb5021a7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:50.658394 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1fb7449a-dc5a-4596-9f99-b629fb5021a7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:50.665448 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1fb7449a-dc5a-4596-9f99-b629fb5021a7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:50.665918 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1fb7449a-dc5a-4596-9f99-b629fb5021a7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:50.666332 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1fb7449a-dc5a-4596-9f99-b629fb5021a7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:50.667189 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1fb7449a-dc5a-4596-9f99-b629fb5021a7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:50.667639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1fb7449a-dc5a-4596-9f99-b629fb5021a7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:50.668059 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1fb7449a-dc5a-4596-9f99-b629fb5021a7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:50.834392 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e0ac2d26-8fb3-483d-9a2f-252c246c8bb9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:50.835031 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e0ac2d26-8fb3-483d-9a2f-252c246c8bb9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:50.841921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e0ac2d26-8fb3-483d-9a2f-252c246c8bb9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:50.842255 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1fb7449a-dc5a-4596-9f99-b629fb5021a7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:50.842445 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e0ac2d26-8fb3-483d-9a2f-252c246c8bb9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:50.842822 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e0ac2d26-8fb3-483d-9a2f-252c246c8bb9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:50.843601 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e0ac2d26-8fb3-483d-9a2f-252c246c8bb9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:50.844036 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e0ac2d26-8fb3-483d-9a2f-252c246c8bb9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:50.844801 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e0ac2d26-8fb3-483d-9a2f-252c246c8bb9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:50.851660 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1fb7449a-dc5a-4596-9f99-b629fb5021a7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:50.853089 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1fb7449a-dc5a-4596-9f99-b629fb5021a7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:50.854305 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1fb7449a-dc5a-4596-9f99-b629fb5021a7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.201090 Aug 26 08:58:50.854881 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 420/851] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:58:50 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:58:50.999004 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e0ac2d26-8fb3-483d-9a2f-252c246c8bb9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:51.008456 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e0ac2d26-8fb3-483d-9a2f-252c246c8bb9 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1690 microversion: 2.1 time: 0.178025 Aug 26 08:58:51.009053 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 432/852] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:50 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:51.878122 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f1cb7ef6-4fd3-4f3b-b83a-dfe88eca11ae tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:51.878749 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f1cb7ef6-4fd3-4f3b-b83a-dfe88eca11ae tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:51.885748 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f1cb7ef6-4fd3-4f3b-b83a-dfe88eca11ae tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:51.886259 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f1cb7ef6-4fd3-4f3b-b83a-dfe88eca11ae tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:51.886684 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f1cb7ef6-4fd3-4f3b-b83a-dfe88eca11ae tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:51.887414 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f1cb7ef6-4fd3-4f3b-b83a-dfe88eca11ae tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:51.887862 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f1cb7ef6-4fd3-4f3b-b83a-dfe88eca11ae tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:51.888279 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f1cb7ef6-4fd3-4f3b-b83a-dfe88eca11ae tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:52.030605 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-33f1b2bf-7954-4dc8-9fa4-704f9add47dc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:52.031367 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-33f1b2bf-7954-4dc8-9fa4-704f9add47dc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:52.037183 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f1cb7ef6-4fd3-4f3b-b83a-dfe88eca11ae tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:52.038223 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-33f1b2bf-7954-4dc8-9fa4-704f9add47dc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:52.038727 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-33f1b2bf-7954-4dc8-9fa4-704f9add47dc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:52.039223 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-33f1b2bf-7954-4dc8-9fa4-704f9add47dc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:52.039937 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-33f1b2bf-7954-4dc8-9fa4-704f9add47dc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:52.040390 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-33f1b2bf-7954-4dc8-9fa4-704f9add47dc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:52.040824 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-33f1b2bf-7954-4dc8-9fa4-704f9add47dc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:52.046117 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f1cb7ef6-4fd3-4f3b-b83a-dfe88eca11ae tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:52.047765 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f1cb7ef6-4fd3-4f3b-b83a-dfe88eca11ae tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:52.048968 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f1cb7ef6-4fd3-4f3b-b83a-dfe88eca11ae tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.175157 Aug 26 08:58:52.049971 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 421/853] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:58:51 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:58:52.177410 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-33f1b2bf-7954-4dc8-9fa4-704f9add47dc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:52.186042 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-33f1b2bf-7954-4dc8-9fa4-704f9add47dc tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1690 microversion: 2.1 time: 0.159438 Aug 26 08:58:52.186638 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 433/854] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:52 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:53.073120 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-37af7507-51c0-4e4f-afea-31b0e99feb7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:53.073787 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-37af7507-51c0-4e4f-afea-31b0e99feb7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:53.081090 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37af7507-51c0-4e4f-afea-31b0e99feb7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:53.081970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37af7507-51c0-4e4f-afea-31b0e99feb7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:53.082618 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37af7507-51c0-4e4f-afea-31b0e99feb7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:53.083409 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37af7507-51c0-4e4f-afea-31b0e99feb7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:53.083848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37af7507-51c0-4e4f-afea-31b0e99feb7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:53.084272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-37af7507-51c0-4e4f-afea-31b0e99feb7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:53.211926 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ee11a2c4-b460-4682-99e6-da495b4a42a5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:53.212535 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ee11a2c4-b460-4682-99e6-da495b4a42a5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:53.219202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ee11a2c4-b460-4682-99e6-da495b4a42a5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:53.219731 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ee11a2c4-b460-4682-99e6-da495b4a42a5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:53.220164 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ee11a2c4-b460-4682-99e6-da495b4a42a5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:53.220868 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ee11a2c4-b460-4682-99e6-da495b4a42a5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:53.221322 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ee11a2c4-b460-4682-99e6-da495b4a42a5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:53.221740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ee11a2c4-b460-4682-99e6-da495b4a42a5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:53.233509 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-37af7507-51c0-4e4f-afea-31b0e99feb7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:53.241994 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-37af7507-51c0-4e4f-afea-31b0e99feb7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:53.243433 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-37af7507-51c0-4e4f-afea-31b0e99feb7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:53.244628 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-37af7507-51c0-4e4f-afea-31b0e99feb7e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.175537 Aug 26 08:58:53.245373 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 422/855] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:58:53 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:58:53.386695 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ee11a2c4-b460-4682-99e6-da495b4a42a5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:53.399938 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ee11a2c4-b460-4682-99e6-da495b4a42a5 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1690 microversion: 2.1 time: 0.191930 Aug 26 08:58:53.400547 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 434/856] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:53 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:58:54.269173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6dc3ae00-4e23-41da-8d5d-666eb14f34e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:54.269804 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6dc3ae00-4e23-41da-8d5d-666eb14f34e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:54.276692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6dc3ae00-4e23-41da-8d5d-666eb14f34e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:54.277168 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6dc3ae00-4e23-41da-8d5d-666eb14f34e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:54.277619 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6dc3ae00-4e23-41da-8d5d-666eb14f34e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:54.278302 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6dc3ae00-4e23-41da-8d5d-666eb14f34e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:54.278749 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6dc3ae00-4e23-41da-8d5d-666eb14f34e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:54.279198 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6dc3ae00-4e23-41da-8d5d-666eb14f34e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:54.419009 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6dc3ae00-4e23-41da-8d5d-666eb14f34e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:54.422731 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9b6f575c-57de-40fb-adcb-d1c179e1d74b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:54.423397 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9b6f575c-57de-40fb-adcb-d1c179e1d74b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:54.427639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6dc3ae00-4e23-41da-8d5d-666eb14f34e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:54.429065 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6dc3ae00-4e23-41da-8d5d-666eb14f34e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:54.430074 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6f575c-57de-40fb-adcb-d1c179e1d74b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:54.430194 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6dc3ae00-4e23-41da-8d5d-666eb14f34e8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.165182 Aug 26 08:58:54.430563 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6f575c-57de-40fb-adcb-d1c179e1d74b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:54.434931 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 423/857] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:58:54 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:58:54.435097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6f575c-57de-40fb-adcb-d1c179e1d74b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:54.435097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6f575c-57de-40fb-adcb-d1c179e1d74b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:54.435097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6f575c-57de-40fb-adcb-d1c179e1d74b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:54.435097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6f575c-57de-40fb-adcb-d1c179e1d74b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:54.568164 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9b6f575c-57de-40fb-adcb-d1c179e1d74b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:54.576685 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9b6f575c-57de-40fb-adcb-d1c179e1d74b tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1690 microversion: 2.1 time: 0.157983 Aug 26 08:58:54.577239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 435/858] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:54 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:55.453634 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-cd60eb1f-9417-4a78-aead-ec719bbb1515 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:55.454398 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-cd60eb1f-9417-4a78-aead-ec719bbb1515 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:55.461051 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cd60eb1f-9417-4a78-aead-ec719bbb1515 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:55.461537 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cd60eb1f-9417-4a78-aead-ec719bbb1515 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:55.461970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cd60eb1f-9417-4a78-aead-ec719bbb1515 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:55.462681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cd60eb1f-9417-4a78-aead-ec719bbb1515 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:55.463167 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cd60eb1f-9417-4a78-aead-ec719bbb1515 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:55.463571 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cd60eb1f-9417-4a78-aead-ec719bbb1515 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:55.599784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2cceb5d7-0417-460f-aaf1-caa50da754d3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:55.601132 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2cceb5d7-0417-460f-aaf1-caa50da754d3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:55.608106 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-cd60eb1f-9417-4a78-aead-ec719bbb1515 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:55.609123 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2cceb5d7-0417-460f-aaf1-caa50da754d3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:55.609793 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2cceb5d7-0417-460f-aaf1-caa50da754d3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:55.610235 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2cceb5d7-0417-460f-aaf1-caa50da754d3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:55.611161 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2cceb5d7-0417-460f-aaf1-caa50da754d3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:55.611869 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2cceb5d7-0417-460f-aaf1-caa50da754d3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:55.612426 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2cceb5d7-0417-460f-aaf1-caa50da754d3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:55.617197 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-cd60eb1f-9417-4a78-aead-ec719bbb1515 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:55.618948 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-cd60eb1f-9417-4a78-aead-ec719bbb1515 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:55.620121 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-cd60eb1f-9417-4a78-aead-ec719bbb1515 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.170558 Aug 26 08:58:55.620693 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 424/859] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:58:55 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:58:55.698446 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2cceb5d7-0417-460f-aaf1-caa50da754d3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:55.707867 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2cceb5d7-0417-460f-aaf1-caa50da754d3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1622 microversion: 2.1 time: 0.113512 Aug 26 08:58:55.708452 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 436/860] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:55 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1622 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:58:55.992996 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-c30339f1-5110-4c3e-ae32-6b3df0dccbfd req-3d778f1d-19a9-4a7e-93ad-61f77879eece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1704235c-9819-4980-9ee0-b46ecd91de2e", "name": "network-vif-deleted", "tag": "a81dfa72-6e98-4baf-ad11-0355ffe802a1"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:58:56.003561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-c30339f1-5110-4c3e-ae32-6b3df0dccbfd req-3d778f1d-19a9-4a7e-93ad-61f77879eece service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:56.003962 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-c30339f1-5110-4c3e-ae32-6b3df0dccbfd req-3d778f1d-19a9-4a7e-93ad-61f77879eece service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:56.004592 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-c30339f1-5110-4c3e-ae32-6b3df0dccbfd req-3d778f1d-19a9-4a7e-93ad-61f77879eece service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:56.017243 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-c30339f1-5110-4c3e-ae32-6b3df0dccbfd req-3d778f1d-19a9-4a7e-93ad-61f77879eece service nova] Creating event network-vif-deleted:a81dfa72-6e98-4baf-ad11-0355ffe802a1 for instance 1704235c-9819-4980-9ee0-b46ecd91de2e on hv-cinder-85236 Aug 26 08:58:56.023344 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-c30339f1-5110-4c3e-ae32-6b3df0dccbfd req-3d778f1d-19a9-4a7e-93ad-61f77879eece service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034348 Aug 26 08:58:56.024578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 425/861] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:58:56.643720 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d2bbc057-6f73-41be-846e-f8a8bcf2d3af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:56.644312 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d2bbc057-6f73-41be-846e-f8a8bcf2d3af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:56.651103 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d2bbc057-6f73-41be-846e-f8a8bcf2d3af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:56.651587 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d2bbc057-6f73-41be-846e-f8a8bcf2d3af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:56.652010 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d2bbc057-6f73-41be-846e-f8a8bcf2d3af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:56.652731 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d2bbc057-6f73-41be-846e-f8a8bcf2d3af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:56.653179 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d2bbc057-6f73-41be-846e-f8a8bcf2d3af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:56.653582 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d2bbc057-6f73-41be-846e-f8a8bcf2d3af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:56.730940 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ca00fdc2-64a8-418e-96ce-cc19ad565eb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:56.731648 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ca00fdc2-64a8-418e-96ce-cc19ad565eb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:56.739148 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca00fdc2-64a8-418e-96ce-cc19ad565eb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:56.739646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca00fdc2-64a8-418e-96ce-cc19ad565eb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:56.740080 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca00fdc2-64a8-418e-96ce-cc19ad565eb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:56.740834 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca00fdc2-64a8-418e-96ce-cc19ad565eb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:56.741272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca00fdc2-64a8-418e-96ce-cc19ad565eb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:56.741662 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca00fdc2-64a8-418e-96ce-cc19ad565eb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:56.777712 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca00fdc2-64a8-418e-96ce-cc19ad565eb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:56.778356 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca00fdc2-64a8-418e-96ce-cc19ad565eb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:56.778899 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ca00fdc2-64a8-418e-96ce-cc19ad565eb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:56.779461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-ca00fdc2-64a8-418e-96ce-cc19ad565eb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lazy-loading 'fault' on Instance uuid 1704235c-9819-4980-9ee0-b46ecd91de2e {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:58:56.803015 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d2bbc057-6f73-41be-846e-f8a8bcf2d3af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:56.826291 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d2bbc057-6f73-41be-846e-f8a8bcf2d3af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:56.828230 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d2bbc057-6f73-41be-846e-f8a8bcf2d3af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:56.829980 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d2bbc057-6f73-41be-846e-f8a8bcf2d3af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.190234 Aug 26 08:58:56.831946 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 437/862] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:58:56 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:58:56.836892 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ca00fdc2-64a8-418e-96ce-cc19ad565eb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:56.845972 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ca00fdc2-64a8-418e-96ce-cc19ad565eb3 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 200 len: 1334 microversion: 2.1 time: 0.119807 Aug 26 08:58:56.847621 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 426/863] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:56 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 1334 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:58:57.854145 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-733ba80b-86a4-4e34-8962-b93cb1aec210 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:57.854723 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-733ba80b-86a4-4e34-8962-b93cb1aec210 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:57.857239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=34 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:57.863227 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-733ba80b-86a4-4e34-8962-b93cb1aec210 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:57.863727 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-733ba80b-86a4-4e34-8962-b93cb1aec210 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:57.864230 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-733ba80b-86a4-4e34-8962-b93cb1aec210 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:57.864883 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-733ba80b-86a4-4e34-8962-b93cb1aec210 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:57.865340 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-733ba80b-86a4-4e34-8962-b93cb1aec210 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:57.865765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-733ba80b-86a4-4e34-8962-b93cb1aec210 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:57.869691 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0d381023-46c0-4779-85c7-5ba4a65da74a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:57.873461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-0d381023-46c0-4779-85c7-5ba4a65da74a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1704235c-9819-4980-9ee0-b46ecd91de2e] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:57.877557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0d381023-46c0-4779-85c7-5ba4a65da74a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:57.878032 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0d381023-46c0-4779-85c7-5ba4a65da74a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:57.878591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0d381023-46c0-4779-85c7-5ba4a65da74a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:57.879323 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0d381023-46c0-4779-85c7-5ba4a65da74a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:57.879773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0d381023-46c0-4779-85c7-5ba4a65da74a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:57.880205 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0d381023-46c0-4779-85c7-5ba4a65da74a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:57.895116 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-0d381023-46c0-4779-85c7-5ba4a65da74a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] HTTP exception thrown: Instance 1704235c-9819-4980-9ee0-b46ecd91de2e could not be found. Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0d381023-46c0-4779-85c7-5ba4a65da74a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Request method failure captured: Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e HTTP/1.1 Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCImvYbics5fHnhYQUsY3Ln3prZ2azA4IHqkelF0XmV2pym4A3ArmldC0YsDyJoDTxdWgxVyBe3sw83XWKq4Qh_K3R2hFZXymYlcdOpI_XFJZIDGJ3P5USGxZ4W6-2jz0estC8rSJF0fF_u2VYoJyDfEZYq6CSipyAHm6hPNY2gWr8Ss Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 01d9fa7bc7124476aa295e69b120becd Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 08:58:57.897108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 08:58:57.898755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_01d9fa7bc7124476aa295e69b120becd", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:58:57.898755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:58:57.898755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 01d9fa7bc7124476aa295e69b120becd Aug 26 08:58:57.898755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:58:57.898755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-ServerRescueNegativeTestJSON-1223166117-project Aug 26 08:58:57.898755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 08:58:57.898755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 08:58:57.898755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 3aced0ed17b946f9961d87a1d4446c37 Aug 26 08:58:57.898755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1223166117-project Aug 26 08:58:57.898755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 08:58:57.898755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance 1704235c-9819-4980-9ee0-b46ecd91de2e could not be found. Aug 26 08:58:57.898755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '1704235c-9819-4980-9ee0-b46ecd91de2e'} Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1704235c-9819-4980-9ee0-b46ecd91de2e could not be found. Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:58:57.900115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1704235c-9819-4980-9ee0-b46ecd91de2e could not be found. Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1704235c-9819-4980-9ee0-b46ecd91de2e could not be found. Aug 26 08:58:57.901774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:58:57.903477 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0d381023-46c0-4779-85c7-5ba4a65da74a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Returning 404 to user: Instance 1704235c-9819-4980-9ee0-b46ecd91de2e could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:58:57.903477 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-0d381023-46c0-4779-85c7-5ba4a65da74a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e" status: 404 len: 111 microversion: 2.1 time: 0.032761 Aug 26 08:58:57.903477 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 427/864] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:58:57 2022] GET /compute/v2.1/servers/1704235c-9819-4980-9ee0-b46ecd91de2e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:58:57.908870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0a77a864-2b09-47fe-91ba-79765d26f355 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '.version_select at 0x7f1367ebc550>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:57.931888 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-0a77a864-2b09-47fe-91ba-79765d26f355 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-636125105" status: 202 len: 0 microversion: 2.1 time: 0.026961 Aug 26 08:58:57.932487 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 428/865] 10.222.0.71 () {58 vars in 1218 bytes} [Fri Aug 26 08:58:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-636125105 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:58:58.022754 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-733ba80b-86a4-4e34-8962-b93cb1aec210 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:58.032035 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-733ba80b-86a4-4e34-8962-b93cb1aec210 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:58.033568 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-733ba80b-86a4-4e34-8962-b93cb1aec210 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:58.034756 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-733ba80b-86a4-4e34-8962-b93cb1aec210 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.184774 Aug 26 08:58:58.035644 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 438/866] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:58:57 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:58:59.058629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-34ef2829-8f54-4656-81e1-79ed2806adaa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:58:59.059932 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-34ef2829-8f54-4656-81e1-79ed2806adaa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:58:59.062035 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:58:59.069411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-34ef2829-8f54-4656-81e1-79ed2806adaa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:59.069939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-34ef2829-8f54-4656-81e1-79ed2806adaa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:59.070450 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-34ef2829-8f54-4656-81e1-79ed2806adaa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:59.071192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-34ef2829-8f54-4656-81e1-79ed2806adaa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:58:59.071641 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-34ef2829-8f54-4656-81e1-79ed2806adaa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:58:59.072066 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-34ef2829-8f54-4656-81e1-79ed2806adaa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:58:59.218504 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-34ef2829-8f54-4656-81e1-79ed2806adaa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:59.227126 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-34ef2829-8f54-4656-81e1-79ed2806adaa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:59.228524 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-34ef2829-8f54-4656-81e1-79ed2806adaa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:58:59.229772 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-34ef2829-8f54-4656-81e1-79ed2806adaa tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.175736 Aug 26 08:58:59.230256 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 429/867] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:58:59 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:00.253929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-35f4c6b7-cf8d-49a1-81ce-a88be6c4c258 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:00.254560 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-35f4c6b7-cf8d-49a1-81ce-a88be6c4c258 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:00.261665 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35f4c6b7-cf8d-49a1-81ce-a88be6c4c258 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:00.262131 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35f4c6b7-cf8d-49a1-81ce-a88be6c4c258 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:00.262593 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35f4c6b7-cf8d-49a1-81ce-a88be6c4c258 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:00.263331 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35f4c6b7-cf8d-49a1-81ce-a88be6c4c258 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:00.263765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35f4c6b7-cf8d-49a1-81ce-a88be6c4c258 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:00.264192 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-35f4c6b7-cf8d-49a1-81ce-a88be6c4c258 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:00.401437 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-35f4c6b7-cf8d-49a1-81ce-a88be6c4c258 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:00.409778 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-35f4c6b7-cf8d-49a1-81ce-a88be6c4c258 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:00.411274 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-35f4c6b7-cf8d-49a1-81ce-a88be6c4c258 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:00.412629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-35f4c6b7-cf8d-49a1-81ce-a88be6c4c258 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.163289 Aug 26 08:59:00.413207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 439/868] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:00 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:00.824460 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-92c8a4f9-6796-4901-b804-cb95c48a982d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:00.825081 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-92c8a4f9-6796-4901-b804-cb95c48a982d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:00.832265 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-92c8a4f9-6796-4901-b804-cb95c48a982d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:00.832750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-92c8a4f9-6796-4901-b804-cb95c48a982d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:00.833189 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-92c8a4f9-6796-4901-b804-cb95c48a982d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:00.833881 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-92c8a4f9-6796-4901-b804-cb95c48a982d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:00.834329 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-92c8a4f9-6796-4901-b804-cb95c48a982d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:00.834756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-92c8a4f9-6796-4901-b804-cb95c48a982d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:00.859953 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-92c8a4f9-6796-4901-b804-cb95c48a982d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Going to try to terminate instance {{(pid=132217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 08:59:00.884055 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:00.943330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-92c8a4f9-6796-4901-b804-cb95c48a982d tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "DELETE /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 204 len: 0 microversion: 2.1 time: 0.122780 Aug 26 08:59:00.944320 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 430/869] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 08:59:00 2022] DELETE /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:59:00.953506 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7cb4e76d-b575-437a-bae4-ba700b79bf07 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:00.954112 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-7cb4e76d-b575-437a-bae4-ba700b79bf07 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:00.963281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7cb4e76d-b575-437a-bae4-ba700b79bf07 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:00.963793 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7cb4e76d-b575-437a-bae4-ba700b79bf07 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:00.964223 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7cb4e76d-b575-437a-bae4-ba700b79bf07 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:00.964939 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7cb4e76d-b575-437a-bae4-ba700b79bf07 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:00.965390 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7cb4e76d-b575-437a-bae4-ba700b79bf07 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:00.965813 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7cb4e76d-b575-437a-bae4-ba700b79bf07 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:01.109093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-7cb4e76d-b575-437a-bae4-ba700b79bf07 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:01.117459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7cb4e76d-b575-437a-bae4-ba700b79bf07 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1507 microversion: 2.1 time: 0.167959 Aug 26 08:59:01.118072 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 440/870] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:00 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:01.437317 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-337d070a-2e5e-491b-955a-a0d4a45cfbe4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:01.438178 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-337d070a-2e5e-491b-955a-a0d4a45cfbe4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:01.445896 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-337d070a-2e5e-491b-955a-a0d4a45cfbe4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:01.446482 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-337d070a-2e5e-491b-955a-a0d4a45cfbe4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:01.447012 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-337d070a-2e5e-491b-955a-a0d4a45cfbe4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:01.447937 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-337d070a-2e5e-491b-955a-a0d4a45cfbe4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:01.448434 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-337d070a-2e5e-491b-955a-a0d4a45cfbe4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:01.448874 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-337d070a-2e5e-491b-955a-a0d4a45cfbe4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:01.589171 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-337d070a-2e5e-491b-955a-a0d4a45cfbe4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:01.598011 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-337d070a-2e5e-491b-955a-a0d4a45cfbe4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:01.599451 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-337d070a-2e5e-491b-955a-a0d4a45cfbe4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:01.600630 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-337d070a-2e5e-491b-955a-a0d4a45cfbe4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.167890 Aug 26 08:59:01.601195 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 431/871] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:01 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:02.140728 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a7144653-23c7-4bdf-a6ac-dca7c6910e95 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:02.141593 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a7144653-23c7-4bdf-a6ac-dca7c6910e95 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:02.148914 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a7144653-23c7-4bdf-a6ac-dca7c6910e95 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:02.149630 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a7144653-23c7-4bdf-a6ac-dca7c6910e95 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:02.150191 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a7144653-23c7-4bdf-a6ac-dca7c6910e95 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:02.150920 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a7144653-23c7-4bdf-a6ac-dca7c6910e95 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:02.151462 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a7144653-23c7-4bdf-a6ac-dca7c6910e95 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:02.151943 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a7144653-23c7-4bdf-a6ac-dca7c6910e95 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:02.156566 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:02.223393 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-ebad5629-b51e-42da-8b4f-8916d15f10a2 req-0f329abd-afde-4538-a827-601fa841bc55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ea47a3-6a48-4509-8799-634e4e77319c", "name": "network-vif-deleted", "tag": "f2f9abb5-5c56-40e3-aed3-5d7eb434f36c"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:02.235414 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-ebad5629-b51e-42da-8b4f-8916d15f10a2 req-0f329abd-afde-4538-a827-601fa841bc55 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:02.235868 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-ebad5629-b51e-42da-8b4f-8916d15f10a2 req-0f329abd-afde-4538-a827-601fa841bc55 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:02.236289 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-ebad5629-b51e-42da-8b4f-8916d15f10a2 req-0f329abd-afde-4538-a827-601fa841bc55 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:02.238125 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a7144653-23c7-4bdf-a6ac-dca7c6910e95 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:02.247498 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a7144653-23c7-4bdf-a6ac-dca7c6910e95 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 200 len: 1465 microversion: 2.1 time: 0.111439 Aug 26 08:59:02.248971 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-ebad5629-b51e-42da-8b4f-8916d15f10a2 req-0f329abd-afde-4538-a827-601fa841bc55 service nova] Creating event network-vif-deleted:f2f9abb5-5c56-40e3-aed3-5d7eb434f36c for instance 14ea47a3-6a48-4509-8799-634e4e77319c on hv-cinder-85236 Aug 26 08:59:02.257734 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-ebad5629-b51e-42da-8b4f-8916d15f10a2 req-0f329abd-afde-4538-a827-601fa841bc55 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037235 Aug 26 08:59:02.259611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 432/873] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:02.259840 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 441/873] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:02 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 1465 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:02.626119 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-78e99645-cd6c-4546-9182-d8fff6765744 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:02.627031 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-78e99645-cd6c-4546-9182-d8fff6765744 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:02.634347 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78e99645-cd6c-4546-9182-d8fff6765744 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:02.635155 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78e99645-cd6c-4546-9182-d8fff6765744 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:02.635592 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78e99645-cd6c-4546-9182-d8fff6765744 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:02.636310 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78e99645-cd6c-4546-9182-d8fff6765744 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:02.636768 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78e99645-cd6c-4546-9182-d8fff6765744 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:02.637522 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78e99645-cd6c-4546-9182-d8fff6765744 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:02.785690 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-78e99645-cd6c-4546-9182-d8fff6765744 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:02.795131 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-78e99645-cd6c-4546-9182-d8fff6765744 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:02.796548 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-78e99645-cd6c-4546-9182-d8fff6765744 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:02.797807 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-78e99645-cd6c-4546-9182-d8fff6765744 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.176636 Aug 26 08:59:02.798399 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 442/874] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:02 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:03.273721 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f838225d-08a1-4d06-a3d0-8c7fd500df87 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:03.274349 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f838225d-08a1-4d06-a3d0-8c7fd500df87 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 14ea47a3-6a48-4509-8799-634e4e77319c] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:03.281343 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f838225d-08a1-4d06-a3d0-8c7fd500df87 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:03.281817 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f838225d-08a1-4d06-a3d0-8c7fd500df87 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:03.282325 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f838225d-08a1-4d06-a3d0-8c7fd500df87 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:03.283160 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f838225d-08a1-4d06-a3d0-8c7fd500df87 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:03.283606 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f838225d-08a1-4d06-a3d0-8c7fd500df87 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:03.284048 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f838225d-08a1-4d06-a3d0-8c7fd500df87 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:03.301027 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-f838225d-08a1-4d06-a3d0-8c7fd500df87 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] HTTP exception thrown: Instance 14ea47a3-6a48-4509-8799-634e4e77319c could not be found. Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f838225d-08a1-4d06-a3d0-8c7fd500df87 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Request method failure captured: Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c HTTP/1.1 Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCImvYbics5fHnhYQUsY3Ln3prZ2azA4IHqkelF0XmV2pym4A3ArmldC0YsDyJoDTxdWgxVyBe3sw83XWKq4Qh_K3R2hFZXymYlcdOpI_XFJZIDGJ3P5USGxZ4W6-2jz0estC8rSJF0fF_u2VYoJyDfEZYq6CSipyAHm6hPNY2gWr8Ss Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 01d9fa7bc7124476aa295e69b120becd Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 08:59:03.302882 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 08:59:03.304554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_01d9fa7bc7124476aa295e69b120becd", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:59:03.304554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:59:03.304554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 01d9fa7bc7124476aa295e69b120becd Aug 26 08:59:03.304554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:59:03.304554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-ServerRescueNegativeTestJSON-1223166117-project Aug 26 08:59:03.304554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 08:59:03.304554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 08:59:03.304554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 3aced0ed17b946f9961d87a1d4446c37 Aug 26 08:59:03.304554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1223166117-project Aug 26 08:59:03.304554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 08:59:03.304554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance 14ea47a3-6a48-4509-8799-634e4e77319c could not be found. Aug 26 08:59:03.304554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '14ea47a3-6a48-4509-8799-634e4e77319c'} Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14ea47a3-6a48-4509-8799-634e4e77319c could not be found. Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:59:03.305367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14ea47a3-6a48-4509-8799-634e4e77319c could not be found. Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14ea47a3-6a48-4509-8799-634e4e77319c could not be found. Aug 26 08:59:03.306769 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:03.308055 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f838225d-08a1-4d06-a3d0-8c7fd500df87 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Returning 404 to user: Instance 14ea47a3-6a48-4509-8799-634e4e77319c could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:59:03.308055 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f838225d-08a1-4d06-a3d0-8c7fd500df87 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c" status: 404 len: 111 microversion: 2.1 time: 0.035735 Aug 26 08:59:03.308055 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 433/875] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:03 2022] GET /compute/v2.1/servers/14ea47a3-6a48-4509-8799-634e4e77319c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:59:03.316101 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-97c09643-3ce1-4c02-849b-b72e9e6afaea tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:03.316658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-97c09643-3ce1-4c02-849b-b72e9e6afaea tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:03.323690 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-97c09643-3ce1-4c02-849b-b72e9e6afaea tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:03.324180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-97c09643-3ce1-4c02-849b-b72e9e6afaea tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:03.324613 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-97c09643-3ce1-4c02-849b-b72e9e6afaea tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:03.325317 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-97c09643-3ce1-4c02-849b-b72e9e6afaea tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:03.325765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-97c09643-3ce1-4c02-849b-b72e9e6afaea tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:03.326188 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-97c09643-3ce1-4c02-849b-b72e9e6afaea tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:03.352176 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-97c09643-3ce1-4c02-849b-b72e9e6afaea tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 08:59:03.436569 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-97c09643-3ce1-4c02-849b-b72e9e6afaea tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "DELETE /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 204 len: 0 microversion: 2.1 time: 0.124504 Aug 26 08:59:03.437182 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 443/876] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 08:59:03 2022] DELETE /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:59:03.445564 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6ee7146d-79b2-4d9a-bf33-d10b24fac30a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:03.446163 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6ee7146d-79b2-4d9a-bf33-d10b24fac30a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:03.452457 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ee7146d-79b2-4d9a-bf33-d10b24fac30a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:03.452968 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ee7146d-79b2-4d9a-bf33-d10b24fac30a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:03.453415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ee7146d-79b2-4d9a-bf33-d10b24fac30a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:03.454098 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ee7146d-79b2-4d9a-bf33-d10b24fac30a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:03.454549 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ee7146d-79b2-4d9a-bf33-d10b24fac30a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:03.454997 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ee7146d-79b2-4d9a-bf33-d10b24fac30a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:03.596774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6ee7146d-79b2-4d9a-bf33-d10b24fac30a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:03.605004 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6ee7146d-79b2-4d9a-bf33-d10b24fac30a tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.163376 Aug 26 08:59:03.605647 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 434/877] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:03 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:59:03.826926 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9d1fc943-a94a-47df-8d1b-ff73be267e25 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:03.828291 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9d1fc943-a94a-47df-8d1b-ff73be267e25 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:03.839036 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d1fc943-a94a-47df-8d1b-ff73be267e25 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:03.839777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d1fc943-a94a-47df-8d1b-ff73be267e25 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:03.840285 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d1fc943-a94a-47df-8d1b-ff73be267e25 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:03.840934 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d1fc943-a94a-47df-8d1b-ff73be267e25 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:03.841463 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d1fc943-a94a-47df-8d1b-ff73be267e25 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:03.841814 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d1fc943-a94a-47df-8d1b-ff73be267e25 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:03.982871 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9d1fc943-a94a-47df-8d1b-ff73be267e25 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:03.991401 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9d1fc943-a94a-47df-8d1b-ff73be267e25 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:03.992850 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-9d1fc943-a94a-47df-8d1b-ff73be267e25 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:03.994030 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9d1fc943-a94a-47df-8d1b-ff73be267e25 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.175679 Aug 26 08:59:03.994595 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 444/878] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:03 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:04.627078 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-123aeff9-d2ac-480b-9b4e-fb16878a7697 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:04.627684 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-123aeff9-d2ac-480b-9b4e-fb16878a7697 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:04.635380 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-123aeff9-d2ac-480b-9b4e-fb16878a7697 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:04.636163 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-123aeff9-d2ac-480b-9b4e-fb16878a7697 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:04.636762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-123aeff9-d2ac-480b-9b4e-fb16878a7697 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:04.637718 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-123aeff9-d2ac-480b-9b4e-fb16878a7697 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:04.638444 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-123aeff9-d2ac-480b-9b4e-fb16878a7697 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:04.638875 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-123aeff9-d2ac-480b-9b4e-fb16878a7697 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:04.798074 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-123aeff9-d2ac-480b-9b4e-fb16878a7697 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:04.807564 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-123aeff9-d2ac-480b-9b4e-fb16878a7697 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.184832 Aug 26 08:59:04.808182 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 435/879] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:04 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:05.019833 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5f26509d-3563-4408-88c5-e14ab99b4134 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:05.020573 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5f26509d-3563-4408-88c5-e14ab99b4134 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:05.027650 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5f26509d-3563-4408-88c5-e14ab99b4134 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:05.028146 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5f26509d-3563-4408-88c5-e14ab99b4134 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:05.028609 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5f26509d-3563-4408-88c5-e14ab99b4134 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:05.029343 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5f26509d-3563-4408-88c5-e14ab99b4134 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:05.029778 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5f26509d-3563-4408-88c5-e14ab99b4134 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:05.030206 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5f26509d-3563-4408-88c5-e14ab99b4134 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:05.179804 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5f26509d-3563-4408-88c5-e14ab99b4134 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:05.188938 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5f26509d-3563-4408-88c5-e14ab99b4134 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:05.190381 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5f26509d-3563-4408-88c5-e14ab99b4134 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:05.191612 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5f26509d-3563-4408-88c5-e14ab99b4134 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.176311 Aug 26 08:59:05.192167 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 445/880] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:05 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:05.829402 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2eca9e6c-9c4d-481d-90d2-2411ff8e0a70 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:05.830036 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2eca9e6c-9c4d-481d-90d2-2411ff8e0a70 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:05.836894 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2eca9e6c-9c4d-481d-90d2-2411ff8e0a70 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:05.837380 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2eca9e6c-9c4d-481d-90d2-2411ff8e0a70 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:05.837809 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2eca9e6c-9c4d-481d-90d2-2411ff8e0a70 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:05.838512 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2eca9e6c-9c4d-481d-90d2-2411ff8e0a70 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:05.838992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2eca9e6c-9c4d-481d-90d2-2411ff8e0a70 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:05.839413 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2eca9e6c-9c4d-481d-90d2-2411ff8e0a70 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:05.991380 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2eca9e6c-9c4d-481d-90d2-2411ff8e0a70 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:05.999553 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2eca9e6c-9c4d-481d-90d2-2411ff8e0a70 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.174134 Aug 26 08:59:05.999553 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 436/881] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:05 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:06.214557 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ad3a6a5f-4cfd-497a-ab87-75330a3f4e62 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:06.215199 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ad3a6a5f-4cfd-497a-ab87-75330a3f4e62 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:06.222166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ad3a6a5f-4cfd-497a-ab87-75330a3f4e62 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:06.222622 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ad3a6a5f-4cfd-497a-ab87-75330a3f4e62 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:06.223097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ad3a6a5f-4cfd-497a-ab87-75330a3f4e62 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:06.224444 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ad3a6a5f-4cfd-497a-ab87-75330a3f4e62 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:06.224444 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ad3a6a5f-4cfd-497a-ab87-75330a3f4e62 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:06.224855 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ad3a6a5f-4cfd-497a-ab87-75330a3f4e62 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:06.365235 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ad3a6a5f-4cfd-497a-ab87-75330a3f4e62 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:06.374349 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ad3a6a5f-4cfd-497a-ab87-75330a3f4e62 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:06.375944 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ad3a6a5f-4cfd-497a-ab87-75330a3f4e62 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:06.377285 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ad3a6a5f-4cfd-497a-ab87-75330a3f4e62 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.166832 Aug 26 08:59:06.377888 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 446/882] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:06 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:07.023807 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-de88aabd-3100-4259-b2f5-cd95b5f022c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:07.024449 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-de88aabd-3100-4259-b2f5-cd95b5f022c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:07.031647 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de88aabd-3100-4259-b2f5-cd95b5f022c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:07.032235 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de88aabd-3100-4259-b2f5-cd95b5f022c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:07.032938 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de88aabd-3100-4259-b2f5-cd95b5f022c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:07.033616 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de88aabd-3100-4259-b2f5-cd95b5f022c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:07.034370 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de88aabd-3100-4259-b2f5-cd95b5f022c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:07.034846 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de88aabd-3100-4259-b2f5-cd95b5f022c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:07.176191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-de88aabd-3100-4259-b2f5-cd95b5f022c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:07.184289 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-de88aabd-3100-4259-b2f5-cd95b5f022c6 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1522 microversion: 2.1 time: 0.164946 Aug 26 08:59:07.184870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 437/883] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:07 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:07.400883 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-21ab6935-445f-4495-a3b7-5c3d4ce44fd4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:07.401516 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-21ab6935-445f-4495-a3b7-5c3d4ce44fd4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:07.410802 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-21ab6935-445f-4495-a3b7-5c3d4ce44fd4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:07.411329 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-21ab6935-445f-4495-a3b7-5c3d4ce44fd4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:07.411771 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-21ab6935-445f-4495-a3b7-5c3d4ce44fd4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:07.412499 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-21ab6935-445f-4495-a3b7-5c3d4ce44fd4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:07.412955 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-21ab6935-445f-4495-a3b7-5c3d4ce44fd4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:07.413376 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-21ab6935-445f-4495-a3b7-5c3d4ce44fd4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:07.651682 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-21ab6935-445f-4495-a3b7-5c3d4ce44fd4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:07.666201 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-21ab6935-445f-4495-a3b7-5c3d4ce44fd4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:07.668119 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-21ab6935-445f-4495-a3b7-5c3d4ce44fd4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:07.669329 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-21ab6935-445f-4495-a3b7-5c3d4ce44fd4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1743 microversion: 2.20 time: 0.272510 Aug 26 08:59:07.669920 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 447/884] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:07 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1743 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:08.056915 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-7412256f-7462-4cec-ae53-24e5fadebfa6 req-cc17a1e7-8570-48a0-96e1-5b3f796c6485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a8b026c-ef95-4a38-8eca-86005625dd30", "name": "network-vif-deleted", "tag": "e25e079a-ddfa-4bd3-849d-dd0e1d98c705"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:08.067988 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-7412256f-7462-4cec-ae53-24e5fadebfa6 req-cc17a1e7-8570-48a0-96e1-5b3f796c6485 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:08.068611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-7412256f-7462-4cec-ae53-24e5fadebfa6 req-cc17a1e7-8570-48a0-96e1-5b3f796c6485 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:08.069034 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-7412256f-7462-4cec-ae53-24e5fadebfa6 req-cc17a1e7-8570-48a0-96e1-5b3f796c6485 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:08.081083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-7412256f-7462-4cec-ae53-24e5fadebfa6 req-cc17a1e7-8570-48a0-96e1-5b3f796c6485 service nova] Creating event network-vif-deleted:e25e079a-ddfa-4bd3-849d-dd0e1d98c705 for instance 1a8b026c-ef95-4a38-8eca-86005625dd30 on hv-cinder-85236 Aug 26 08:59:08.086597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-7412256f-7462-4cec-ae53-24e5fadebfa6 req-cc17a1e7-8570-48a0-96e1-5b3f796c6485 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033341 Aug 26 08:59:08.087250 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 438/885] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:08.206187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c356deeb-ddeb-41fe-aad5-956254b886eb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:08.206818 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c356deeb-ddeb-41fe-aad5-956254b886eb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:08.215690 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c356deeb-ddeb-41fe-aad5-956254b886eb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:08.215690 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c356deeb-ddeb-41fe-aad5-956254b886eb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:08.215690 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c356deeb-ddeb-41fe-aad5-956254b886eb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:08.215690 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c356deeb-ddeb-41fe-aad5-956254b886eb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:08.216155 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c356deeb-ddeb-41fe-aad5-956254b886eb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:08.216155 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c356deeb-ddeb-41fe-aad5-956254b886eb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:08.249109 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c356deeb-ddeb-41fe-aad5-956254b886eb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:08.249593 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c356deeb-ddeb-41fe-aad5-956254b886eb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:08.250031 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c356deeb-ddeb-41fe-aad5-956254b886eb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:08.250477 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-c356deeb-ddeb-41fe-aad5-956254b886eb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lazy-loading 'fault' on Instance uuid 1a8b026c-ef95-4a38-8eca-86005625dd30 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:08.305013 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c356deeb-ddeb-41fe-aad5-956254b886eb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aced0ed17b946f9961d87a1d4446c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9fa7bc7124476aa295e69b120becd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:08.314007 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c356deeb-ddeb-41fe-aad5-956254b886eb tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 200 len: 1312 microversion: 2.1 time: 0.111722 Aug 26 08:59:08.315083 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 448/886] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:08 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:08.702914 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ac7b236d-87b2-4f53-a119-07c34c88f935 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:08.703614 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ac7b236d-87b2-4f53-a119-07c34c88f935 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:08.710110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ac7b236d-87b2-4f53-a119-07c34c88f935 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:08.710549 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ac7b236d-87b2-4f53-a119-07c34c88f935 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:08.711017 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ac7b236d-87b2-4f53-a119-07c34c88f935 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:08.711706 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ac7b236d-87b2-4f53-a119-07c34c88f935 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:08.712154 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ac7b236d-87b2-4f53-a119-07c34c88f935 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:08.712558 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ac7b236d-87b2-4f53-a119-07c34c88f935 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:08.852485 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ac7b236d-87b2-4f53-a119-07c34c88f935 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:08.863074 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ac7b236d-87b2-4f53-a119-07c34c88f935 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:08.864510 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ac7b236d-87b2-4f53-a119-07c34c88f935 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:08.865664 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ac7b236d-87b2-4f53-a119-07c34c88f935 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1743 microversion: 2.20 time: 0.167425 Aug 26 08:59:08.866221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 439/887] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:08 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:09.336082 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4f9c675f-683e-4ccf-bce0-ed92babbe676 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:09.336787 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4f9c675f-683e-4ccf-bce0-ed92babbe676 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] [instance: 1a8b026c-ef95-4a38-8eca-86005625dd30] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:09.344012 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f9c675f-683e-4ccf-bce0-ed92babbe676 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:09.344583 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f9c675f-683e-4ccf-bce0-ed92babbe676 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:09.345120 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f9c675f-683e-4ccf-bce0-ed92babbe676 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:09.346054 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f9c675f-683e-4ccf-bce0-ed92babbe676 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:09.346529 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f9c675f-683e-4ccf-bce0-ed92babbe676 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:09.346936 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f9c675f-683e-4ccf-bce0-ed92babbe676 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:09.362181 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-4f9c675f-683e-4ccf-bce0-ed92babbe676 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] HTTP exception thrown: Instance 1a8b026c-ef95-4a38-8eca-86005625dd30 could not be found. Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4f9c675f-683e-4ccf-bce0-ed92babbe676 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Request method failure captured: Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 HTTP/1.1 Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCImvYbics5fHnhYQUsY3Ln3prZ2azA4IHqkelF0XmV2pym4A3ArmldC0YsDyJoDTxdWgxVyBe3sw83XWKq4Qh_K3R2hFZXymYlcdOpI_XFJZIDGJ3P5USGxZ4W6-2jz0estC8rSJF0fF_u2VYoJyDfEZYq6CSipyAHm6hPNY2gWr8Ss Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 01d9fa7bc7124476aa295e69b120becd Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 08:59:09.363887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 08:59:09.366590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_01d9fa7bc7124476aa295e69b120becd", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/01d9fa7bc7124476aa295e69b120becd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:59:09.366590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:59:09.366590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 01d9fa7bc7124476aa295e69b120becd Aug 26 08:59:09.366590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1223166117 Aug 26 08:59:09.366590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-ServerRescueNegativeTestJSON-1223166117-project Aug 26 08:59:09.366590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 08:59:09.366590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 08:59:09.366590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 3aced0ed17b946f9961d87a1d4446c37 Aug 26 08:59:09.366590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1223166117-project Aug 26 08:59:09.366590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 08:59:09.366590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance 1a8b026c-ef95-4a38-8eca-86005625dd30 could not be found. Aug 26 08:59:09.366590 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': '1a8b026c-ef95-4a38-8eca-86005625dd30'} Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a8b026c-ef95-4a38-8eca-86005625dd30 could not be found. Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:59:09.368048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a8b026c-ef95-4a38-8eca-86005625dd30 could not be found. Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a8b026c-ef95-4a38-8eca-86005625dd30 could not be found. Aug 26 08:59:09.370342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:09.374029 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4f9c675f-683e-4ccf-bce0-ed92babbe676 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] Returning 404 to user: Instance 1a8b026c-ef95-4a38-8eca-86005625dd30 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:59:09.374029 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4f9c675f-683e-4ccf-bce0-ed92babbe676 tempest-ServerRescueNegativeTestJSON-1223166117 tempest-ServerRescueNegativeTestJSON-1223166117-project] 10.222.0.71 "GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30" status: 404 len: 111 microversion: 2.1 time: 0.033298 Aug 26 08:59:09.374029 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 449/888] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:09 2022] GET /compute/v2.1/servers/1a8b026c-ef95-4a38-8eca-86005625dd30 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 08:59:09.892136 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c7a04119-3c44-40f5-a22b-4be91f148cf3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:09.892961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c7a04119-3c44-40f5-a22b-4be91f148cf3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:09.900731 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c7a04119-3c44-40f5-a22b-4be91f148cf3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:09.901299 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c7a04119-3c44-40f5-a22b-4be91f148cf3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:09.901973 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c7a04119-3c44-40f5-a22b-4be91f148cf3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:09.902861 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c7a04119-3c44-40f5-a22b-4be91f148cf3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:09.903332 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c7a04119-3c44-40f5-a22b-4be91f148cf3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:09.903760 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c7a04119-3c44-40f5-a22b-4be91f148cf3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:10.077221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c7a04119-3c44-40f5-a22b-4be91f148cf3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:10.086521 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c7a04119-3c44-40f5-a22b-4be91f148cf3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:10.088579 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c7a04119-3c44-40f5-a22b-4be91f148cf3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:10.090745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c7a04119-3c44-40f5-a22b-4be91f148cf3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1743 microversion: 2.20 time: 0.203072 Aug 26 08:59:10.091720 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 440/889] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:09 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1743 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:10.521997 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-fd2e8bf7-ff5c-4f23-ba8a-03d40267e344 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1492471970"}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:10.522680 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-fd2e8bf7-ff5c-4f23-ba8a-03d40267e344 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:10.530367 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd2e8bf7-ff5c-4f23-ba8a-03d40267e344 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:10.531223 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd2e8bf7-ff5c-4f23-ba8a-03d40267e344 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:10.531974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd2e8bf7-ff5c-4f23-ba8a-03d40267e344 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:10.533015 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd2e8bf7-ff5c-4f23-ba8a-03d40267e344 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:10.533789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd2e8bf7-ff5c-4f23-ba8a-03d40267e344 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:10.534445 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fd2e8bf7-ff5c-4f23-ba8a-03d40267e344 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:10.803814 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.network.security_group_api [None req-fd2e8bf7-ff5c-4f23-ba8a-03d40267e344 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Removing security group 31c69cac-9709-43b6-b7b2-868d43622288 from port 43e50f95-c491-4a41-90fb-e5677acb9448 Aug 26 08:59:11.118697 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9fefe06e-5075-4f0f-b8c5-276ca16ccf7f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:11.119371 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9fefe06e-5075-4f0f-b8c5-276ca16ccf7f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:11.127494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9fefe06e-5075-4f0f-b8c5-276ca16ccf7f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:11.128462 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9fefe06e-5075-4f0f-b8c5-276ca16ccf7f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:11.129294 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9fefe06e-5075-4f0f-b8c5-276ca16ccf7f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:11.131979 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9fefe06e-5075-4f0f-b8c5-276ca16ccf7f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:11.132953 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9fefe06e-5075-4f0f-b8c5-276ca16ccf7f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:11.137986 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9fefe06e-5075-4f0f-b8c5-276ca16ccf7f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:11.370681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9fefe06e-5075-4f0f-b8c5-276ca16ccf7f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:11.393669 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9fefe06e-5075-4f0f-b8c5-276ca16ccf7f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:11.400349 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9fefe06e-5075-4f0f-b8c5-276ca16ccf7f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:11.401903 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9fefe06e-5075-4f0f-b8c5-276ca16ccf7f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1738 microversion: 2.20 time: 0.287840 Aug 26 08:59:11.402643 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 441/890] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:11 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1738 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:11.744329 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-fd2e8bf7-ff5c-4f23-ba8a-03d40267e344 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "POST /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/action" status: 202 len: 0 microversion: 2.1 time: 1.227197 Aug 26 08:59:11.749748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 450/891] 10.222.0.71 () {60 vars in 1278 bytes} [Fri Aug 26 08:59:10 2022] POST /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/action => generated 0 bytes in 1230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 08:59:11.760641 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-8056f338-fa8f-4ce8-9bea-174970700c0d req-defdbbe1-819f-42ab-bd2c-1608b3d16403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840c5e09-c3d3-4dd9-8812-fe9915934abf", "tag": "43e50f95-c491-4a41-90fb-e5677acb9448"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:11.775688 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-8056f338-fa8f-4ce8-9bea-174970700c0d req-defdbbe1-819f-42ab-bd2c-1608b3d16403 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:11.785331 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-8056f338-fa8f-4ce8-9bea-174970700c0d req-defdbbe1-819f-42ab-bd2c-1608b3d16403 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:11.785928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-8056f338-fa8f-4ce8-9bea-174970700c0d req-defdbbe1-819f-42ab-bd2c-1608b3d16403 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:11.804236 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-8056f338-fa8f-4ce8-9bea-174970700c0d req-defdbbe1-819f-42ab-bd2c-1608b3d16403 service nova] Creating event network-changed:43e50f95-c491-4a41-90fb-e5677acb9448 for instance 840c5e09-c3d3-4dd9-8812-fe9915934abf on hv-cinder-85236 Aug 26 08:59:11.821738 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-8056f338-fa8f-4ce8-9bea-174970700c0d req-defdbbe1-819f-42ab-bd2c-1608b3d16403 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064587 Aug 26 08:59:11.849537 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 442/892] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:12.348436 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-35f0341e-769b-4b6d-8aea-801331ef22f5 req-5a0b80c1-05d9-4bc2-976d-8d8dc4cb8d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbfe1e03-de30-4198-9a4d-a96708dbb98b", "name": "network-vif-plugged", "status": "completed", "tag": "57b16be7-70f7-4545-b557-e106d767a915"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:12.372176 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-35f0341e-769b-4b6d-8aea-801331ef22f5 req-5a0b80c1-05d9-4bc2-976d-8d8dc4cb8d4b service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:12.373140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-35f0341e-769b-4b6d-8aea-801331ef22f5 req-5a0b80c1-05d9-4bc2-976d-8d8dc4cb8d4b service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:12.377634 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-35f0341e-769b-4b6d-8aea-801331ef22f5 req-5a0b80c1-05d9-4bc2-976d-8d8dc4cb8d4b service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:12.412870 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-35f0341e-769b-4b6d-8aea-801331ef22f5 req-5a0b80c1-05d9-4bc2-976d-8d8dc4cb8d4b service nova] Creating event network-vif-plugged:57b16be7-70f7-4545-b557-e106d767a915 for instance cbfe1e03-de30-4198-9a4d-a96708dbb98b on hv-cinder-85236 Aug 26 08:59:12.427767 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-35f0341e-769b-4b6d-8aea-801331ef22f5 req-5a0b80c1-05d9-4bc2-976d-8d8dc4cb8d4b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081602 Aug 26 08:59:12.430578 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 451/893] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:12.437223 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-86a0f1bd-6571-44fe-9e83-0a38c3ebf733 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:12.437916 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-86a0f1bd-6571-44fe-9e83-0a38c3ebf733 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:12.460035 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-86a0f1bd-6571-44fe-9e83-0a38c3ebf733 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:12.460928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-86a0f1bd-6571-44fe-9e83-0a38c3ebf733 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:12.461510 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-86a0f1bd-6571-44fe-9e83-0a38c3ebf733 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:12.462340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-86a0f1bd-6571-44fe-9e83-0a38c3ebf733 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:12.462800 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-86a0f1bd-6571-44fe-9e83-0a38c3ebf733 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:12.464821 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-86a0f1bd-6571-44fe-9e83-0a38c3ebf733 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:12.829887 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-86a0f1bd-6571-44fe-9e83-0a38c3ebf733 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:12.840150 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-86a0f1bd-6571-44fe-9e83-0a38c3ebf733 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:12.843291 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-86a0f1bd-6571-44fe-9e83-0a38c3ebf733 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:12.845425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-86a0f1bd-6571-44fe-9e83-0a38c3ebf733 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1738 microversion: 2.20 time: 0.412402 Aug 26 08:59:12.847568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 443/894] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:12 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1738 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:13.872509 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b0752adf-0ad9-4e36-a6f9-4708280ff2df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:13.873948 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b0752adf-0ad9-4e36-a6f9-4708280ff2df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:13.885860 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b0752adf-0ad9-4e36-a6f9-4708280ff2df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:13.888513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b0752adf-0ad9-4e36-a6f9-4708280ff2df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:13.889099 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b0752adf-0ad9-4e36-a6f9-4708280ff2df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:13.890720 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b0752adf-0ad9-4e36-a6f9-4708280ff2df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:13.893873 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b0752adf-0ad9-4e36-a6f9-4708280ff2df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:13.894452 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b0752adf-0ad9-4e36-a6f9-4708280ff2df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:14.113551 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b0752adf-0ad9-4e36-a6f9-4708280ff2df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:14.128848 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b0752adf-0ad9-4e36-a6f9-4708280ff2df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:14.137504 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b0752adf-0ad9-4e36-a6f9-4708280ff2df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:14.141210 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b0752adf-0ad9-4e36-a6f9-4708280ff2df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1738 microversion: 2.20 time: 0.273904 Aug 26 08:59:14.160505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 452/895] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:13 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:14.285374 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9c96871b-9720-4b6f-ae70-d62261d8c87f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:14.285944 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9c96871b-9720-4b6f-ae70-d62261d8c87f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:14.300354 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-de66156b-88e4-46aa-a429-988fb5556198 req-ad0e06c4-39b6-4e6a-acf0-9affff9b30f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840c5e09-c3d3-4dd9-8812-fe9915934abf", "tag": "43e50f95-c491-4a41-90fb-e5677acb9448"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:14.308800 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9c96871b-9720-4b6f-ae70-d62261d8c87f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:14.309286 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9c96871b-9720-4b6f-ae70-d62261d8c87f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:14.309721 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9c96871b-9720-4b6f-ae70-d62261d8c87f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:14.310430 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9c96871b-9720-4b6f-ae70-d62261d8c87f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:14.310917 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9c96871b-9720-4b6f-ae70-d62261d8c87f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:14.312667 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9c96871b-9720-4b6f-ae70-d62261d8c87f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:14.333717 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-de66156b-88e4-46aa-a429-988fb5556198 req-ad0e06c4-39b6-4e6a-acf0-9affff9b30f2 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:14.338079 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-de66156b-88e4-46aa-a429-988fb5556198 req-ad0e06c4-39b6-4e6a-acf0-9affff9b30f2 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:14.338978 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-de66156b-88e4-46aa-a429-988fb5556198 req-ad0e06c4-39b6-4e6a-acf0-9affff9b30f2 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:14.389201 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-de66156b-88e4-46aa-a429-988fb5556198 req-ad0e06c4-39b6-4e6a-acf0-9affff9b30f2 service nova] Creating event network-changed:43e50f95-c491-4a41-90fb-e5677acb9448 for instance 840c5e09-c3d3-4dd9-8812-fe9915934abf on hv-cinder-85236 Aug 26 08:59:14.404961 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-de66156b-88e4-46aa-a429-988fb5556198 req-ad0e06c4-39b6-4e6a-acf0-9affff9b30f2 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109220 Aug 26 08:59:14.429867 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 453/896] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:59:14.468382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-9c96871b-9720-4b6f-ae70-d62261d8c87f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lazy-loading 'services' on Instance uuid 840c5e09-c3d3-4dd9-8812-fe9915934abf {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:14.772753 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9c96871b-9720-4b6f-ae70-d62261d8c87f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "DELETE /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/os-volume_attachments/7f6b9a59-6e2d-41b2-b933-cb3091c1fb42" status: 202 len: 0 microversion: 2.1 time: 0.492631 Aug 26 08:59:14.780087 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 444/897] 10.222.0.71 () {58 vars in 1416 bytes} [Fri Aug 26 08:59:14 2022] DELETE /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/os-volume_attachments/7f6b9a59-6e2d-41b2-b933-cb3091c1fb42 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:59:14.791410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-58ad48bc-a924-47b3-8e98-a971ce39ea74 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:14.800074 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-58ad48bc-a924-47b3-8e98-a971ce39ea74 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:14.827216 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-58ad48bc-a924-47b3-8e98-a971ce39ea74 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:14.832506 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-58ad48bc-a924-47b3-8e98-a971ce39ea74 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:14.835989 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-58ad48bc-a924-47b3-8e98-a971ce39ea74 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:14.837591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-58ad48bc-a924-47b3-8e98-a971ce39ea74 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:14.838356 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-58ad48bc-a924-47b3-8e98-a971ce39ea74 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:14.844133 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-58ad48bc-a924-47b3-8e98-a971ce39ea74 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:14.862567 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-df1dab07-7bfc-4971-a454-f3e3a6320a71 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:14.864270 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-df1dab07-7bfc-4971-a454-f3e3a6320a71 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:14.907271 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-58ad48bc-a924-47b3-8e98-a971ce39ea74 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122125 Aug 26 08:59:14.912184 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 445/898] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:14 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:59:14.912424 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-df1dab07-7bfc-4971-a454-f3e3a6320a71 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:14.912424 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-df1dab07-7bfc-4971-a454-f3e3a6320a71 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:14.912424 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-df1dab07-7bfc-4971-a454-f3e3a6320a71 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:14.914644 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-df1dab07-7bfc-4971-a454-f3e3a6320a71 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:14.919464 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-df1dab07-7bfc-4971-a454-f3e3a6320a71 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:14.920041 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-df1dab07-7bfc-4971-a454-f3e3a6320a71 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:14.950205 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-df1dab07-7bfc-4971-a454-f3e3a6320a71 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/ips" status: 200 len: 149 microversion: 2.1 time: 0.197027 Aug 26 08:59:14.955015 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 454/899] 10.222.0.71 () {58 vars in 1248 bytes} [Fri Aug 26 08:59:14 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/ips => generated 149 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:15.179111 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d6d0cdc7-9669-4ab5-9532-7abc001c0fa4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:15.179733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d6d0cdc7-9669-4ab5-9532-7abc001c0fa4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:15.198922 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d6d0cdc7-9669-4ab5-9532-7abc001c0fa4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:15.203112 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d6d0cdc7-9669-4ab5-9532-7abc001c0fa4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:15.203783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d6d0cdc7-9669-4ab5-9532-7abc001c0fa4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:15.204733 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d6d0cdc7-9669-4ab5-9532-7abc001c0fa4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:15.205199 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d6d0cdc7-9669-4ab5-9532-7abc001c0fa4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:15.205620 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d6d0cdc7-9669-4ab5-9532-7abc001c0fa4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:15.922479 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d94a2ff8-3d83-4ed0-a7e9-835a96605b80 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:15.929458 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d94a2ff8-3d83-4ed0-a7e9-835a96605b80 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:15.950911 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d94a2ff8-3d83-4ed0-a7e9-835a96605b80 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:15.962627 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d94a2ff8-3d83-4ed0-a7e9-835a96605b80 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:15.966687 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d94a2ff8-3d83-4ed0-a7e9-835a96605b80 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:15.972958 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d94a2ff8-3d83-4ed0-a7e9-835a96605b80 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:15.976442 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d94a2ff8-3d83-4ed0-a7e9-835a96605b80 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:15.979404 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d94a2ff8-3d83-4ed0-a7e9-835a96605b80 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:16.057962 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d94a2ff8-3d83-4ed0-a7e9-835a96605b80 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.140421 Aug 26 08:59:16.060749 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 455/900] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:15 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 08:59:16.087556 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6cd2e3c4-21a0-4ce2-8208-16824d98cf34 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:16.089675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6cd2e3c4-21a0-4ce2-8208-16824d98cf34 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:16.113793 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6cd2e3c4-21a0-4ce2-8208-16824d98cf34 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:16.114586 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6cd2e3c4-21a0-4ce2-8208-16824d98cf34 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:16.115088 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6cd2e3c4-21a0-4ce2-8208-16824d98cf34 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:16.118512 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6cd2e3c4-21a0-4ce2-8208-16824d98cf34 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:16.118512 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6cd2e3c4-21a0-4ce2-8208-16824d98cf34 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:16.118930 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6cd2e3c4-21a0-4ce2-8208-16824d98cf34 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:16.220886 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d6d0cdc7-9669-4ab5-9532-7abc001c0fa4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:16.232111 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d6d0cdc7-9669-4ab5-9532-7abc001c0fa4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:16.236088 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d6d0cdc7-9669-4ab5-9532-7abc001c0fa4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:16.239724 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d6d0cdc7-9669-4ab5-9532-7abc001c0fa4 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1738 microversion: 2.20 time: 1.064161 Aug 26 08:59:16.241562 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 446/901] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:15 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1738 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:16.396725 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-6cd2e3c4-21a0-4ce2-8208-16824d98cf34 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] HTTP exception thrown: Instance 840c5e09-c3d3-4dd9-8812-fe9915934abf is not attached to volume 7f6b9a59-6e2d-41b2-b933-cb3091c1fb42 Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6cd2e3c4-21a0-4ce2-8208-16824d98cf34 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Request method failure captured: Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: DELETE /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/os-volume_attachments/7f6b9a59-6e2d-41b2-b933-cb3091c1fb42 HTTP/1.1 Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCIp1EL_zPvxcn6o-L-KLDmv2MP2JRsK09BoZj5agPqovi_XURVDOd-W7vLM8ReCEpbaaJkZmWcssj3OBwLXmKMJeFAw2zaznvrSl1De1nW6W1UvaIXLy1BEhL3tKNcdM7yPsxhKC9fWfIhGLlSoG4eB28kwYhue8rma9pfYfyf0nops Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 3d18cb354a0f46faba6c00b89b4e4b1c Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-TestMinimumBasicScenario-1966924362 Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 08:59:16.399457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 08:59:16.401081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_3d18cb354a0f46faba6c00b89b4e4b1c", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/3d18cb354a0f46faba6c00b89b4e4b1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/3d18cb354a0f46faba6c00b89b4e4b1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/3d18cb354a0f46faba6c00b89b4e4b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:59:16.401081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-TestMinimumBasicScenario-1966924362 Aug 26 08:59:16.401081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 3d18cb354a0f46faba6c00b89b4e4b1c Aug 26 08:59:16.401081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1966924362 Aug 26 08:59:16.401081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-TestMinimumBasicScenario-1966924362-project Aug 26 08:59:16.401081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 08:59:16.401081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 08:59:16.401081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 2cee3394dbdd4cb3a52005ee357d3be7 Aug 26 08:59:16.401081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-TestMinimumBasicScenario-1966924362-project Aug 26 08:59:16.401081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 08:59:16.401081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance 840c5e09-c3d3-4dd9-8812-fe9915934abf is not attached to volume 7f6b9a59-6e2d-41b2-b933-cb3091c1fb42 Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'server_id': '840c5e09-c3d3-4dd9-8812-fe9915934abf', 'id': '7f6b9a59-6e2d-41b2-b933-cb3091c1fb42'} Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7f6b9a59-6e2d-41b2-b933-cb3091c1fb42. Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:59:16.401966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:59:16.403421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:59:16.403421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 26 08:59:16.403421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 26 08:59:16.403421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840c5e09-c3d3-4dd9-8812-fe9915934abf is not attached to volume 7f6b9a59-6e2d-41b2-b933-cb3091c1fb42 Aug 26 08:59:16.403421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:16.403421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:16.403421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:16.403421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:16.403421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:16.403421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:16.403421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:59:16.403421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:59:16.403421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840c5e09-c3d3-4dd9-8812-fe9915934abf is not attached to volume 7f6b9a59-6e2d-41b2-b933-cb3091c1fb42 Aug 26 08:59:16.403421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:16.406389 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6cd2e3c4-21a0-4ce2-8208-16824d98cf34 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Returning 404 to user: Instance 840c5e09-c3d3-4dd9-8812-fe9915934abf is not attached to volume 7f6b9a59-6e2d-41b2-b933-cb3091c1fb42 {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:59:16.414006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6cd2e3c4-21a0-4ce2-8208-16824d98cf34 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "DELETE /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/os-volume_attachments/7f6b9a59-6e2d-41b2-b933-cb3091c1fb42" status: 404 len: 154 microversion: 2.1 time: 0.338297 Aug 26 08:59:16.416257 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 456/902] 10.222.0.71 () {58 vars in 1416 bytes} [Fri Aug 26 08:59:16 2022] DELETE /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf/os-volume_attachments/7f6b9a59-6e2d-41b2-b933-cb3091c1fb42 => generated 154 bytes in 343 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:59:16.772187 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-04b452c8-1bf5-45c2-88db-7d9b815ac82c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07a41118-eca1-4af0-ae2d-8194c2d1d21c"}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:16.776016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-04b452c8-1bf5-45c2-88db-7d9b815ac82c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:16.802802 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-04b452c8-1bf5-45c2-88db-7d9b815ac82c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:16.803563 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-04b452c8-1bf5-45c2-88db-7d9b815ac82c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:16.804020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-04b452c8-1bf5-45c2-88db-7d9b815ac82c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:16.804834 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-04b452c8-1bf5-45c2-88db-7d9b815ac82c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:16.805313 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-04b452c8-1bf5-45c2-88db-7d9b815ac82c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:16.805796 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-04b452c8-1bf5-45c2-88db-7d9b815ac82c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:17.101869 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:17.270839 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2c54d038-48b5-4f29-b8b0-f5aea96767a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:17.272394 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2c54d038-48b5-4f29-b8b0-f5aea96767a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:17.293494 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2c54d038-48b5-4f29-b8b0-f5aea96767a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:17.295548 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2c54d038-48b5-4f29-b8b0-f5aea96767a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:17.296239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2c54d038-48b5-4f29-b8b0-f5aea96767a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:17.297187 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-04b452c8-1bf5-45c2-88db-7d9b815ac82c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "POST /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.539721 Aug 26 08:59:17.297740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2c54d038-48b5-4f29-b8b0-f5aea96767a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:17.298678 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2c54d038-48b5-4f29-b8b0-f5aea96767a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:17.299494 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2c54d038-48b5-4f29-b8b0-f5aea96767a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:17.305557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 447/903] 10.222.0.71 () {60 vars in 1323 bytes} [Fri Aug 26 08:59:16 2022] POST /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:17.585297 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2c54d038-48b5-4f29-b8b0-f5aea96767a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:17.597298 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2c54d038-48b5-4f29-b8b0-f5aea96767a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:17.599311 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2c54d038-48b5-4f29-b8b0-f5aea96767a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:17.600538 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2c54d038-48b5-4f29-b8b0-f5aea96767a8 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1738 microversion: 2.20 time: 0.335428 Aug 26 08:59:17.611518 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 457/904] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:17 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1738 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:59:17.788449 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4f3fda5f-b441-44a3-832d-ef8c4e8515d0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:17.789103 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4f3fda5f-b441-44a3-832d-ef8c4e8515d0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:17.801066 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f3fda5f-b441-44a3-832d-ef8c4e8515d0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:17.805898 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f3fda5f-b441-44a3-832d-ef8c4e8515d0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:17.806338 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f3fda5f-b441-44a3-832d-ef8c4e8515d0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:17.807319 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f3fda5f-b441-44a3-832d-ef8c4e8515d0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:17.807824 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f3fda5f-b441-44a3-832d-ef8c4e8515d0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:17.810863 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f3fda5f-b441-44a3-832d-ef8c4e8515d0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:17.845126 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4f3fda5f-b441-44a3-832d-ef8c4e8515d0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Going to try to terminate instance {{(pid=132217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 08:59:17.967587 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4f3fda5f-b441-44a3-832d-ef8c4e8515d0 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "DELETE /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 204 len: 0 microversion: 2.1 time: 0.181626 Aug 26 08:59:17.971908 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 448/905] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 08:59:17 2022] DELETE /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 08:59:17.985025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6a2ddf52-cb2b-4783-8bb1-3eac5d1ed77b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:17.988011 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6a2ddf52-cb2b-4783-8bb1-3eac5d1ed77b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:18.006343 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a2ddf52-cb2b-4783-8bb1-3eac5d1ed77b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:18.010305 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a2ddf52-cb2b-4783-8bb1-3eac5d1ed77b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:18.011011 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a2ddf52-cb2b-4783-8bb1-3eac5d1ed77b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:18.014266 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a2ddf52-cb2b-4783-8bb1-3eac5d1ed77b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:18.016938 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a2ddf52-cb2b-4783-8bb1-3eac5d1ed77b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:18.018282 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6a2ddf52-cb2b-4783-8bb1-3eac5d1ed77b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:18.045910 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:18.228843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6a2ddf52-cb2b-4783-8bb1-3eac5d1ed77b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:18.241397 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6a2ddf52-cb2b-4783-8bb1-3eac5d1ed77b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1555 microversion: 2.1 time: 0.263847 Aug 26 08:59:18.242231 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 458/906] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:17 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1555 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:18.633770 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f72cff53-41c0-4735-be65-3d581a863670 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:18.636471 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f72cff53-41c0-4735-be65-3d581a863670 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:18.648893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f72cff53-41c0-4735-be65-3d581a863670 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:18.649575 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f72cff53-41c0-4735-be65-3d581a863670 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:18.650545 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f72cff53-41c0-4735-be65-3d581a863670 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:18.653391 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f72cff53-41c0-4735-be65-3d581a863670 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:18.656950 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f72cff53-41c0-4735-be65-3d581a863670 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:18.657828 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f72cff53-41c0-4735-be65-3d581a863670 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:18.844812 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f72cff53-41c0-4735-be65-3d581a863670 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:18.854687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f72cff53-41c0-4735-be65-3d581a863670 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:18.857022 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f72cff53-41c0-4735-be65-3d581a863670 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:18.858564 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f72cff53-41c0-4735-be65-3d581a863670 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1738 microversion: 2.20 time: 0.238121 Aug 26 08:59:18.859893 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 449/907] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:18 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:59:18.932628 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-30e20cdd-1487-44ad-b86a-8aa867a72c7e tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Action: 'create', calling method: .version_select at 0x7f1367da5b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1403959399"}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:19.265536 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9a5921a4-2b4a-44a0-a9cf-79b77ea44020 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:19.266168 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9a5921a4-2b4a-44a0-a9cf-79b77ea44020 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:19.273816 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a5921a4-2b4a-44a0-a9cf-79b77ea44020 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:19.274547 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a5921a4-2b4a-44a0-a9cf-79b77ea44020 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:19.275218 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a5921a4-2b4a-44a0-a9cf-79b77ea44020 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:19.275915 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a5921a4-2b4a-44a0-a9cf-79b77ea44020 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:19.276524 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a5921a4-2b4a-44a0-a9cf-79b77ea44020 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:19.277105 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a5921a4-2b4a-44a0-a9cf-79b77ea44020 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:19.486555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9a5921a4-2b4a-44a0-a9cf-79b77ea44020 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:19.494129 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-30e20cdd-1487-44ad-b86a-8aa867a72c7e tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.718249 Aug 26 08:59:19.495030 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 459/908] 10.222.0.71 () {60 vars in 1155 bytes} [Fri Aug 26 08:59:18 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 720 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 26 08:59:19.504088 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9a5921a4-2b4a-44a0-a9cf-79b77ea44020 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1555 microversion: 2.1 time: 0.236354 Aug 26 08:59:19.504088 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 450/909] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:19 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:59:19.511238 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-dce1e8b4-2acb-4deb-a436-817e2a693f70 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f136c0e7f70>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:19.618217 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-dce1e8b4-2acb-4deb-a436-817e2a693f70 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89" status: 200 len: 345 microversion: 2.1 time: 0.112622 Aug 26 08:59:19.619116 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 460/910] 10.222.0.71 () {58 vars in 1245 bytes} [Fri Aug 26 08:59:19 2022] GET /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89 => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:19.887085 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-05991736-3550-4447-9a93-53960f4e1381 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:19.888637 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-05991736-3550-4447-9a93-53960f4e1381 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:19.896232 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-05991736-3550-4447-9a93-53960f4e1381 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:19.897024 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-05991736-3550-4447-9a93-53960f4e1381 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:19.897649 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-05991736-3550-4447-9a93-53960f4e1381 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:19.898722 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-05991736-3550-4447-9a93-53960f4e1381 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:19.899393 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-05991736-3550-4447-9a93-53960f4e1381 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:19.899848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-05991736-3550-4447-9a93-53960f4e1381 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:20.071137 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-05991736-3550-4447-9a93-53960f4e1381 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:20.086668 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-05991736-3550-4447-9a93-53960f4e1381 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:20.088879 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-05991736-3550-4447-9a93-53960f4e1381 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:20.090110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-05991736-3550-4447-9a93-53960f4e1381 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1738 microversion: 2.20 time: 0.207431 Aug 26 08:59:20.090675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 451/911] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:19 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:20.306716 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2cab2d1b-a926-4e4e-abd7-097daac8f530 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:20.307683 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2cab2d1b-a926-4e4e-abd7-097daac8f530 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:20.315039 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2cab2d1b-a926-4e4e-abd7-097daac8f530 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:20.315944 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2cab2d1b-a926-4e4e-abd7-097daac8f530 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:20.316598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2cab2d1b-a926-4e4e-abd7-097daac8f530 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:20.317675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2cab2d1b-a926-4e4e-abd7-097daac8f530 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:20.318376 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2cab2d1b-a926-4e4e-abd7-097daac8f530 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:20.318916 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2cab2d1b-a926-4e4e-abd7-097daac8f530 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:20.362182 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2cab2d1b-a926-4e4e-abd7-097daac8f530 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/ips" status: 200 len: 146 microversion: 2.1 time: 0.061379 Aug 26 08:59:20.363711 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 461/912] 10.222.0.71 () {58 vars in 1248 bytes} [Fri Aug 26 08:59:20 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/ips => generated 146 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:20.520085 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f27f16df-4e6d-4623-a34d-dd3ae0f423f6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:20.520692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f27f16df-4e6d-4623-a34d-dd3ae0f423f6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:20.530635 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f27f16df-4e6d-4623-a34d-dd3ae0f423f6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:20.532528 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f27f16df-4e6d-4623-a34d-dd3ae0f423f6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:20.537470 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f27f16df-4e6d-4623-a34d-dd3ae0f423f6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:20.538283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f27f16df-4e6d-4623-a34d-dd3ae0f423f6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:20.538768 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f27f16df-4e6d-4623-a34d-dd3ae0f423f6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:20.539230 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f27f16df-4e6d-4623-a34d-dd3ae0f423f6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:20.637400 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5551bfba-6535-4058-bd9f-511f8cf21238 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f136c04f160>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:20.865074 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f27f16df-4e6d-4623-a34d-dd3ae0f423f6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:20.885514 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f27f16df-4e6d-4623-a34d-dd3ae0f423f6 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1555 microversion: 2.1 time: 0.369312 Aug 26 08:59:20.886762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 452/913] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:20 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1555 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:20.912213 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5551bfba-6535-4058-bd9f-511f8cf21238 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89" status: 200 len: 346 microversion: 2.1 time: 0.273804 Aug 26 08:59:20.914138 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 462/914] 10.222.0.71 () {58 vars in 1245 bytes} [Fri Aug 26 08:59:20 2022] GET /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89 => generated 346 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:59:20.934439 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-04d0bd14-ef79-402c-998a-287e6fb98ba2 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Action: 'create', calling method: .version_select at 0x7f1367ebfc10>, body: {"snapshot": {"volume_id": "e9b2ebab-fe69-404f-803c-95ce899bfd89", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1378415282"}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:21.128262 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-65785b2e-87da-43c8-b626-b3bfcc1e56d2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:21.128895 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-65785b2e-87da-43c8-b626-b3bfcc1e56d2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:21.151238 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-65785b2e-87da-43c8-b626-b3bfcc1e56d2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:21.152255 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-65785b2e-87da-43c8-b626-b3bfcc1e56d2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:21.155105 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-65785b2e-87da-43c8-b626-b3bfcc1e56d2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:21.158986 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-65785b2e-87da-43c8-b626-b3bfcc1e56d2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:21.161180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-65785b2e-87da-43c8-b626-b3bfcc1e56d2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:21.162189 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-65785b2e-87da-43c8-b626-b3bfcc1e56d2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:21.359572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-04d0bd14-ef79-402c-998a-287e6fb98ba2 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.429920 Aug 26 08:59:21.360516 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 453/915] 10.222.0.71 () {60 vars in 1162 bytes} [Fri Aug 26 08:59:20 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:21.387169 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9ba9a827-962e-4272-a61d-d59c9aa499aa tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f1367e98ca0>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:21.463467 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9ba9a827-962e-4272-a61d-d59c9aa499aa tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d" status: 200 len: 287 microversion: 2.1 time: 0.085912 Aug 26 08:59:21.465293 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 454/916] 10.222.0.71 () {58 vars in 1251 bytes} [Fri Aug 26 08:59:21 2022] GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:21.479089 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-34161fc8-b078-493a-bdc5-46db81caf85c req-d636ce32-6149-4530-a324-d1353c5e2a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "840c5e09-c3d3-4dd9-8812-fe9915934abf", "name": "network-vif-deleted", "tag": "43e50f95-c491-4a41-90fb-e5677acb9448"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:21.492475 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-34161fc8-b078-493a-bdc5-46db81caf85c req-d636ce32-6149-4530-a324-d1353c5e2a79 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:21.492955 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-34161fc8-b078-493a-bdc5-46db81caf85c req-d636ce32-6149-4530-a324-d1353c5e2a79 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:21.493439 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-34161fc8-b078-493a-bdc5-46db81caf85c req-d636ce32-6149-4530-a324-d1353c5e2a79 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:21.508783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-34161fc8-b078-493a-bdc5-46db81caf85c req-d636ce32-6149-4530-a324-d1353c5e2a79 service nova] Creating event network-vif-deleted:43e50f95-c491-4a41-90fb-e5677acb9448 for instance 840c5e09-c3d3-4dd9-8812-fe9915934abf on hv-cinder-85236 Aug 26 08:59:21.519193 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-34161fc8-b078-493a-bdc5-46db81caf85c req-d636ce32-6149-4530-a324-d1353c5e2a79 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052124 Aug 26 08:59:21.520224 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 455/917] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:21.526634 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-49aeebc5-b6ec-4381-90ff-257803b45120 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f136c0655e0>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:21.539889 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-65785b2e-87da-43c8-b626-b3bfcc1e56d2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:21.573992 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-65785b2e-87da-43c8-b626-b3bfcc1e56d2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:21.576118 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-65785b2e-87da-43c8-b626-b3bfcc1e56d2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:21.577412 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-65785b2e-87da-43c8-b626-b3bfcc1e56d2 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1738 microversion: 2.20 time: 0.462503 Aug 26 08:59:21.603312 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 463/918] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:21 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1738 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:21.633551 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-49aeebc5-b6ec-4381-90ff-257803b45120 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.111696 Aug 26 08:59:21.634605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 456/919] 10.222.0.71 () {58 vars in 1140 bytes} [Fri Aug 26 08:59:21 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:21.648766 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0d1c52ef-00d4-4e9d-84b6-c8a4432fee5e tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f136c089310>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:21.690353 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0d1c52ef-00d4-4e9d-84b6-c8a4432fee5e tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d" status: 200 len: 287 microversion: 2.1 time: 0.045815 Aug 26 08:59:21.691779 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 464/920] 10.222.0.71 () {58 vars in 1251 bytes} [Fri Aug 26 08:59:21 2022] GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:21.923574 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-bffa8132-750c-43c7-b128-7928d152c709 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:21.924735 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-bffa8132-750c-43c7-b128-7928d152c709 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:21.932429 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bffa8132-750c-43c7-b128-7928d152c709 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:21.933228 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bffa8132-750c-43c7-b128-7928d152c709 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:21.933663 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bffa8132-750c-43c7-b128-7928d152c709 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:21.934431 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bffa8132-750c-43c7-b128-7928d152c709 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:21.934906 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bffa8132-750c-43c7-b128-7928d152c709 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:21.935599 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bffa8132-750c-43c7-b128-7928d152c709 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:21.980913 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bffa8132-750c-43c7-b128-7928d152c709 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:21.981544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bffa8132-750c-43c7-b128-7928d152c709 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:21.982107 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bffa8132-750c-43c7-b128-7928d152c709 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:21.982571 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-bffa8132-750c-43c7-b128-7928d152c709 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lazy-loading 'fault' on Instance uuid 840c5e09-c3d3-4dd9-8812-fe9915934abf {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:22.039252 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-cd4e3f9b-b643-454a-9af8-38692062da8f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d3ee2db-0482-4d9a-9ae3-0dc019f68d64"}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:22.042084 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-cd4e3f9b-b643-454a-9af8-38692062da8f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:22.050466 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-bffa8132-750c-43c7-b128-7928d152c709 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:22.055049 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd4e3f9b-b643-454a-9af8-38692062da8f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:22.055858 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd4e3f9b-b643-454a-9af8-38692062da8f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:22.056462 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd4e3f9b-b643-454a-9af8-38692062da8f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:22.057449 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd4e3f9b-b643-454a-9af8-38692062da8f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:22.058123 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd4e3f9b-b643-454a-9af8-38692062da8f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:22.058724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd4e3f9b-b643-454a-9af8-38692062da8f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:22.059694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-bffa8132-750c-43c7-b128-7928d152c709 tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1349 microversion: 2.1 time: 0.140256 Aug 26 08:59:22.062644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 457/921] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:21 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1349 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:22.610426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ab6ae2b6-5db2-4901-81d0-887ea6870122 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:22.611508 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ab6ae2b6-5db2-4901-81d0-887ea6870122 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:22.620003 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab6ae2b6-5db2-4901-81d0-887ea6870122 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:22.620623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab6ae2b6-5db2-4901-81d0-887ea6870122 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:22.621289 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab6ae2b6-5db2-4901-81d0-887ea6870122 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:22.622479 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab6ae2b6-5db2-4901-81d0-887ea6870122 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:22.623170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab6ae2b6-5db2-4901-81d0-887ea6870122 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:22.623795 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab6ae2b6-5db2-4901-81d0-887ea6870122 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:22.813513 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ab6ae2b6-5db2-4901-81d0-887ea6870122 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:22.823675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ab6ae2b6-5db2-4901-81d0-887ea6870122 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:22.824558 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ab6ae2b6-5db2-4901-81d0-887ea6870122 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:22.825773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ab6ae2b6-5db2-4901-81d0-887ea6870122 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1738 microversion: 2.20 time: 0.220015 Aug 26 08:59:22.826359 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 458/922] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:22 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:59:22.843455 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c527614e-487a-4b84-9e91-cdbc0482c6f2 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f1367ebc310>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:22.872025 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c527614e-487a-4b84-9e91-cdbc0482c6f2 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d" status: 200 len: 287 microversion: 2.1 time: 0.043870 Aug 26 08:59:22.872863 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 459/923] 10.222.0.71 () {58 vars in 1251 bytes} [Fri Aug 26 08:59:22 2022] GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:23.088104 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-57670cca-a924-462d-be2f-b6c7ea2346ff tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:23.089194 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-57670cca-a924-462d-be2f-b6c7ea2346ff tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:23.099897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57670cca-a924-462d-be2f-b6c7ea2346ff tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:23.100803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57670cca-a924-462d-be2f-b6c7ea2346ff tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:23.101500 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57670cca-a924-462d-be2f-b6c7ea2346ff tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:23.102627 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57670cca-a924-462d-be2f-b6c7ea2346ff tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:23.103352 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57670cca-a924-462d-be2f-b6c7ea2346ff tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:23.103924 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57670cca-a924-462d-be2f-b6c7ea2346ff tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:23.163960 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57670cca-a924-462d-be2f-b6c7ea2346ff tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:23.164440 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57670cca-a924-462d-be2f-b6c7ea2346ff tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:23.164881 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-57670cca-a924-462d-be2f-b6c7ea2346ff tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:23.165322 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-57670cca-a924-462d-be2f-b6c7ea2346ff tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lazy-loading 'fault' on Instance uuid 840c5e09-c3d3-4dd9-8812-fe9915934abf {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:23.215390 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-57670cca-a924-462d-be2f-b6c7ea2346ff tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:23.225605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-57670cca-a924-462d-be2f-b6c7ea2346ff tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1349 microversion: 2.1 time: 0.143488 Aug 26 08:59:23.226203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 460/924] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:23 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1349 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:23.860574 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-433428cf-f4bb-4567-b4d1-805574247ba9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:23.861358 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-433428cf-f4bb-4567-b4d1-805574247ba9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:23.868549 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-433428cf-f4bb-4567-b4d1-805574247ba9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:23.869022 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-433428cf-f4bb-4567-b4d1-805574247ba9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:23.869433 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-433428cf-f4bb-4567-b4d1-805574247ba9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:23.870136 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-433428cf-f4bb-4567-b4d1-805574247ba9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:23.870580 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-433428cf-f4bb-4567-b4d1-805574247ba9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:23.871063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-433428cf-f4bb-4567-b4d1-805574247ba9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:24.021254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-433428cf-f4bb-4567-b4d1-805574247ba9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:24.030307 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-433428cf-f4bb-4567-b4d1-805574247ba9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:24.031866 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-433428cf-f4bb-4567-b4d1-805574247ba9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:24.033342 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-433428cf-f4bb-4567-b4d1-805574247ba9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1738 microversion: 2.20 time: 0.176947 Aug 26 08:59:24.034152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 461/925] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:23 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:24.039077 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-52fcfb4c-7d6d-41ec-abe2-94cf80fafe6d tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f1367ebc940>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:24.070475 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-52fcfb4c-7d6d-41ec-abe2-94cf80fafe6d tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d" status: 200 len: 287 microversion: 2.1 time: 0.035181 Aug 26 08:59:24.071115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 462/926] 10.222.0.71 () {58 vars in 1251 bytes} [Fri Aug 26 08:59:24 2022] GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:24.252201 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-541dbb9a-2a4e-4b2f-ab67-c301f5acfd8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:24.253080 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-541dbb9a-2a4e-4b2f-ab67-c301f5acfd8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:24.259344 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-541dbb9a-2a4e-4b2f-ab67-c301f5acfd8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:24.259836 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-541dbb9a-2a4e-4b2f-ab67-c301f5acfd8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:24.260288 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-541dbb9a-2a4e-4b2f-ab67-c301f5acfd8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:24.260986 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-541dbb9a-2a4e-4b2f-ab67-c301f5acfd8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:24.261439 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-541dbb9a-2a4e-4b2f-ab67-c301f5acfd8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:24.261958 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-541dbb9a-2a4e-4b2f-ab67-c301f5acfd8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:24.306828 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-541dbb9a-2a4e-4b2f-ab67-c301f5acfd8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:24.307480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-541dbb9a-2a4e-4b2f-ab67-c301f5acfd8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:24.308506 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-541dbb9a-2a4e-4b2f-ab67-c301f5acfd8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:24.308834 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-541dbb9a-2a4e-4b2f-ab67-c301f5acfd8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lazy-loading 'fault' on Instance uuid 840c5e09-c3d3-4dd9-8812-fe9915934abf {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:24.357287 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-541dbb9a-2a4e-4b2f-ab67-c301f5acfd8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:24.366103 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-541dbb9a-2a4e-4b2f-ab67-c301f5acfd8b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1349 microversion: 2.1 time: 0.118085 Aug 26 08:59:24.366689 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 463/927] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:24 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1349 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:24.656423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-cd4e3f9b-b643-454a-9af8-38692062da8f tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "POST /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.621039 Aug 26 08:59:24.657252 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 465/928] 10.222.0.71 () {60 vars in 1323 bytes} [Fri Aug 26 08:59:22 2022] POST /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments => generated 194 bytes in 2623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:59:25.056192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ba9bb6fb-e2ca-4c9d-9034-8a30fe459a0b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:25.056852 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ba9bb6fb-e2ca-4c9d-9034-8a30fe459a0b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:25.063959 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba9bb6fb-e2ca-4c9d-9034-8a30fe459a0b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:25.064452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba9bb6fb-e2ca-4c9d-9034-8a30fe459a0b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:25.064899 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba9bb6fb-e2ca-4c9d-9034-8a30fe459a0b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:25.065594 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba9bb6fb-e2ca-4c9d-9034-8a30fe459a0b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:25.066110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba9bb6fb-e2ca-4c9d-9034-8a30fe459a0b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:25.066536 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ba9bb6fb-e2ca-4c9d-9034-8a30fe459a0b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:25.085707 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2bff015a-8afa-4a89-ac40-d417b869607b tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f136c28a790>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:25.125522 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2bff015a-8afa-4a89-ac40-d417b869607b tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d" status: 200 len: 288 microversion: 2.1 time: 0.044919 Aug 26 08:59:25.126530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 466/929] 10.222.0.71 () {58 vars in 1251 bytes} [Fri Aug 26 08:59:25 2022] GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d => generated 288 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:25.139441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3b94423d-966e-46de-976e-906cb4f2a526 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f136c074ca0>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:25.224530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3b94423d-966e-46de-976e-906cb4f2a526 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "DELETE /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d" status: 202 len: 0 microversion: 2.1 time: 0.089656 Aug 26 08:59:25.225260 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 467/930] 10.222.0.71 () {58 vars in 1254 bytes} [Fri Aug 26 08:59:25 2022] DELETE /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 08:59:25.232198 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ba9bb6fb-e2ca-4c9d-9034-8a30fe459a0b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:25.239402 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b2ee84f4-5da9-46b9-bb21-5e306104a361 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f1367dd7550>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:25.249333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ba9bb6fb-e2ca-4c9d-9034-8a30fe459a0b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:25.250903 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ba9bb6fb-e2ca-4c9d-9034-8a30fe459a0b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:25.252683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ba9bb6fb-e2ca-4c9d-9034-8a30fe459a0b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1738 microversion: 2.20 time: 0.200572 Aug 26 08:59:25.253877 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 464/931] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:25 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:25.293859 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b2ee84f4-5da9-46b9-bb21-5e306104a361 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d" status: 200 len: 287 microversion: 2.1 time: 0.061460 Aug 26 08:59:25.294731 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 468/932] 10.222.0.71 () {58 vars in 1251 bytes} [Fri Aug 26 08:59:25 2022] GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:25.389986 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-046425c8-4d52-4fd0-a53c-8699722b8e0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:25.391199 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-046425c8-4d52-4fd0-a53c-8699722b8e0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:25.399492 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-046425c8-4d52-4fd0-a53c-8699722b8e0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:25.400257 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-046425c8-4d52-4fd0-a53c-8699722b8e0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:25.400834 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-046425c8-4d52-4fd0-a53c-8699722b8e0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:25.401849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-046425c8-4d52-4fd0-a53c-8699722b8e0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:25.402337 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-046425c8-4d52-4fd0-a53c-8699722b8e0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:25.402801 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-046425c8-4d52-4fd0-a53c-8699722b8e0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:25.437476 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-046425c8-4d52-4fd0-a53c-8699722b8e0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:25.438315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-046425c8-4d52-4fd0-a53c-8699722b8e0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:25.438751 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-046425c8-4d52-4fd0-a53c-8699722b8e0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:25.439262 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-046425c8-4d52-4fd0-a53c-8699722b8e0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lazy-loading 'fault' on Instance uuid 840c5e09-c3d3-4dd9-8812-fe9915934abf {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:25.492862 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-046425c8-4d52-4fd0-a53c-8699722b8e0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cee3394dbdd4cb3a52005ee357d3be7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d18cb354a0f46faba6c00b89b4e4b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:25.505464 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-046425c8-4d52-4fd0-a53c-8699722b8e0b tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 200 len: 1349 microversion: 2.1 time: 0.120366 Aug 26 08:59:25.506052 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 465/933] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:25 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 1349 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:26.285088 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-aa1da1fc-63b3-4df1-8212-74e6c40f9e65 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:26.289716 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-aa1da1fc-63b3-4df1-8212-74e6c40f9e65 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:26.309041 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-519b257f-d044-4b20-96f1-2d37ade8060d tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f1367ebfca0>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:26.318033 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa1da1fc-63b3-4df1-8212-74e6c40f9e65 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:26.318947 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa1da1fc-63b3-4df1-8212-74e6c40f9e65 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:26.319667 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa1da1fc-63b3-4df1-8212-74e6c40f9e65 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:26.320671 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa1da1fc-63b3-4df1-8212-74e6c40f9e65 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:26.321295 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa1da1fc-63b3-4df1-8212-74e6c40f9e65 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:26.322995 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa1da1fc-63b3-4df1-8212-74e6c40f9e65 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:26.378824 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-519b257f-d044-4b20-96f1-2d37ade8060d tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] HTTP exception thrown: Snapshot 799f2492-fc72-4f3d-a8ca-978c74b7286d could not be found. Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-519b257f-d044-4b20-96f1-2d37ade8060d tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Request method failure captured: Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d HTTP/1.1 Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCItm0QsHbZMMGk27WOU08tbwRo29jrvk9P92DLNaeJELAnj_s0iRZElAZLvcluhj6Uh2fiQZdhSs7wOz-G0Yk5svX1RYutSOUVpkK8agwzANkHl1-VINmc4sI_frCXTneAlJZjTZPZ-CWmzdqFyMAmT2bg3hW96k_erCW19bclb8FqE Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: f7e75f903f7942dda7df96c0300baf46 Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1200334186 Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 08:59:26.383369 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 08:59:26.386345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f7e75f903f7942dda7df96c0300baf46", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f7e75f903f7942dda7df96c0300baf46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f7e75f903f7942dda7df96c0300baf46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f7e75f903f7942dda7df96c0300baf46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:59:26.386345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1200334186 Aug 26 08:59:26.386345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: f7e75f903f7942dda7df96c0300baf46 Aug 26 08:59:26.386345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1200334186 Aug 26 08:59:26.386345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-VolumesSnapshotsTestJSON-1200334186-project Aug 26 08:59:26.386345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 08:59:26.386345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 08:59:26.386345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 71b7df583d74468a8a7ae47f0190c220 Aug 26 08:59:26.386345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1200334186-project Aug 26 08:59:26.386345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: Aug 26 08:59:26.386345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Snapshot 799f2492-fc72-4f3d-a8ca-978c74b7286d could not be found. Aug 26 08:59:26.386345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '799f2492-fc72-4f3d-a8ca-978c74b7286d'} Aug 26 08:59:26.386345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 799f2492-fc72-4f3d-a8ca-978c74b7286d could not be found. (HTTP 404) (Request-ID: req-659365f9-860e-4ac5-9a8a-4330b094a140) Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:26.388152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 08:59:26.390930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 799f2492-fc72-4f3d-a8ca-978c74b7286d could not be found. Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 26 08:59:26.393746 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:59:26.401530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 799f2492-fc72-4f3d-a8ca-978c74b7286d could not be found. Aug 26 08:59:26.401530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:26.401530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:26.401530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:26.401530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:26.401530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:26.401530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:26.401530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:59:26.401530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:59:26.401530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 799f2492-fc72-4f3d-a8ca-978c74b7286d could not be found. Aug 26 08:59:26.401530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:26.401530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-519b257f-d044-4b20-96f1-2d37ade8060d tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Returning 404 to user: Snapshot 799f2492-fc72-4f3d-a8ca-978c74b7286d could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:59:26.401530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-519b257f-d044-4b20-96f1-2d37ade8060d tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d" status: 404 len: 111 microversion: 2.1 time: 0.092770 Aug 26 08:59:26.403047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 466/934] 10.222.0.71 () {58 vars in 1251 bytes} [Fri Aug 26 08:59:26 2022] GET /compute/v2.1/os-snapshots/799f2492-fc72-4f3d-a8ca-978c74b7286d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:59:26.409573 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b593584c-d2ca-4c47-93cc-c0eccbc8e232 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f136c0655e0>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:26.498202 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b593584c-d2ca-4c47-93cc-c0eccbc8e232 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89" status: 202 len: 0 microversion: 2.1 time: 0.094882 Aug 26 08:59:26.499552 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 467/935] 10.222.0.71 () {58 vars in 1248 bytes} [Fri Aug 26 08:59:26 2022] DELETE /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 08:59:26.509190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f53fedec-2136-41b4-9e35-61fdc40a9874 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f136c0eaca0>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:26.576278 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f53fedec-2136-41b4-9e35-61fdc40a9874 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89" status: 200 len: 345 microversion: 2.1 time: 0.071890 Aug 26 08:59:26.576988 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 468/936] 10.222.0.71 () {58 vars in 1245 bytes} [Fri Aug 26 08:59:26 2022] GET /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89 => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:59:26.583516 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1edc27b8-293f-4cc3-b818-ac1d5239518f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:26.584483 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1edc27b8-293f-4cc3-b818-ac1d5239518f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] [instance: 840c5e09-c3d3-4dd9-8812-fe9915934abf] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:26.593574 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1edc27b8-293f-4cc3-b818-ac1d5239518f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:26.594260 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1edc27b8-293f-4cc3-b818-ac1d5239518f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:26.594981 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1edc27b8-293f-4cc3-b818-ac1d5239518f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:26.595955 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1edc27b8-293f-4cc3-b818-ac1d5239518f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:26.596652 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1edc27b8-293f-4cc3-b818-ac1d5239518f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:26.597056 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1edc27b8-293f-4cc3-b818-ac1d5239518f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:26.616517 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-1edc27b8-293f-4cc3-b818-ac1d5239518f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] HTTP exception thrown: Instance 840c5e09-c3d3-4dd9-8812-fe9915934abf could not be found. Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1edc27b8-293f-4cc3-b818-ac1d5239518f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Request method failure captured: Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf HTTP/1.1 Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIp1EL_zPvxcn6o-L-KLDmv2MP2JRsK09BoZj5agPqovi_XURVDOd-W7vLM8ReCEpbaaJkZmWcssj3OBwLXmKMJeFAw2zaznvrSl1De1nW6W1UvaIXLy1BEhL3tKNcdM7yPsxhKC9fWfIhGLlSoG4eB28kwYhue8rma9pfYfyf0nops Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 3d18cb354a0f46faba6c00b89b4e4b1c Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-TestMinimumBasicScenario-1966924362 Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 08:59:26.618550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 08:59:26.620263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_3d18cb354a0f46faba6c00b89b4e4b1c", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/3d18cb354a0f46faba6c00b89b4e4b1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/3d18cb354a0f46faba6c00b89b4e4b1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/3d18cb354a0f46faba6c00b89b4e4b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:59:26.620263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-TestMinimumBasicScenario-1966924362 Aug 26 08:59:26.620263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 3d18cb354a0f46faba6c00b89b4e4b1c Aug 26 08:59:26.620263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1966924362 Aug 26 08:59:26.620263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-TestMinimumBasicScenario-1966924362-project Aug 26 08:59:26.620263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 08:59:26.620263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 08:59:26.620263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 2cee3394dbdd4cb3a52005ee357d3be7 Aug 26 08:59:26.620263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-TestMinimumBasicScenario-1966924362-project Aug 26 08:59:26.620263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 08:59:26.620263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance 840c5e09-c3d3-4dd9-8812-fe9915934abf could not be found. Aug 26 08:59:26.620263 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '840c5e09-c3d3-4dd9-8812-fe9915934abf'} Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 840c5e09-c3d3-4dd9-8812-fe9915934abf could not be found. Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:59:26.621161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840c5e09-c3d3-4dd9-8812-fe9915934abf could not be found. Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840c5e09-c3d3-4dd9-8812-fe9915934abf could not be found. Aug 26 08:59:26.622683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:26.624018 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1edc27b8-293f-4cc3-b818-ac1d5239518f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Returning 404 to user: Instance 840c5e09-c3d3-4dd9-8812-fe9915934abf could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:59:26.624018 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1edc27b8-293f-4cc3-b818-ac1d5239518f tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf" status: 404 len: 111 microversion: 2.1 time: 0.041787 Aug 26 08:59:26.624018 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 469/937] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:26 2022] GET /compute/v2.1/servers/840c5e09-c3d3-4dd9-8812-fe9915934abf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:59:26.634085 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-453d5754-f2c2-4a64-ac78-100f11784c0d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] Calling method '.version_select at 0x7f1367ebf040>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:26.640961 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-aa1da1fc-63b3-4df1-8212-74e6c40f9e65 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:26.652724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-aa1da1fc-63b3-4df1-8212-74e6c40f9e65 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:26.655436 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-aa1da1fc-63b3-4df1-8212-74e6c40f9e65 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:26.657452 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-aa1da1fc-63b3-4df1-8212-74e6c40f9e65 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1720 microversion: 2.20 time: 0.381430 Aug 26 08:59:26.658503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 469/938] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:26 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1720 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:26.668521 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-453d5754-f2c2-4a64-ac78-100f11784c0d tempest-TestMinimumBasicScenario-1966924362 tempest-TestMinimumBasicScenario-1966924362-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1168771069" status: 202 len: 0 microversion: 2.1 time: 0.038762 Aug 26 08:59:26.669417 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 470/939] 10.222.0.71 () {58 vars in 1272 bytes} [Fri Aug 26 08:59:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1168771069 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:59:27.318635 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-478c2ee9-240e-4946-842b-212aed66223f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07a41118-eca1-4af0-ae2d-8194c2d1d21c"}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:27.321204 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-478c2ee9-240e-4946-842b-212aed66223f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:27.329106 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-478c2ee9-240e-4946-842b-212aed66223f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:27.329836 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-478c2ee9-240e-4946-842b-212aed66223f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:27.330481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-478c2ee9-240e-4946-842b-212aed66223f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:27.331256 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-478c2ee9-240e-4946-842b-212aed66223f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:27.331720 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-478c2ee9-240e-4946-842b-212aed66223f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:27.333117 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-478c2ee9-240e-4946-842b-212aed66223f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:27.436823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-478c2ee9-240e-4946-842b-212aed66223f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] HTTP exception thrown: Invalid volume: volume 07a41118-eca1-4af0-ae2d-8194c2d1d21c is already attached to instances: 0695da3e-654d-4b9d-be68-e195e539e831 Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-478c2ee9-240e-4946-842b-212aed66223f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Request method failure captured: Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: POST /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments HTTP/1.1 Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 74 Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCIoEmQS0ltyE06Nj4PuDW7tRWlQx7ddVxbpmBorGEN4vH-Qi6t2BygustSi6IBEkokqI2I_SWwZYOmA6m8lhi8TWDRbttWpAHlEIqCkO0TFDD5IrIzdgnbzjwj6reGrNhrygHKk-ixwJbs_wRUzJRPtDT1VapHI831oEiCSS5Q537B4 Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 08:59:27.439092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 08:59:27.441281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f87dce6d7f01455fb8c3cfe128c20e72", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:59:27.441281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:59:27.441281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 08:59:27.441281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:59:27.441281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 08:59:27.441281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 08:59:27.441281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 08:59:27.441281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 406be06d6adf40bbb48d9baf12022988 Aug 26 08:59:27.441281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 08:59:27.441281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Aug 26 08:59:27.441281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {"volumeAttachment": {"volumeId": "07a41118-eca1-4af0-ae2d-8194c2d1d21c"}} Aug 26 08:59:27.441281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Invalid volume: volume 07a41118-eca1-4af0-ae2d-8194c2d1d21c is already attached to instances: 0695da3e-654d-4b9d-be68-e195e539e831 Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'server_id': '0695da3e-654d-4b9d-be68-e195e539e831', 'body': {'volumeAttachment': {'volumeId': '07a41118-eca1-4af0-ae2d-8194c2d1d21c'}}} Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 07a41118-eca1-4af0-ae2d-8194c2d1d21c is already attached to instances: 0695da3e-654d-4b9d-be68-e195e539e831 Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.442800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 07a41118-eca1-4af0-ae2d-8194c2d1d21c is already attached to instances: 0695da3e-654d-4b9d-be68-e195e539e831 Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.445625 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:27.448356 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:27.448356 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:59:27.448356 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:59:27.448356 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 07a41118-eca1-4af0-ae2d-8194c2d1d21c is already attached to instances: 0695da3e-654d-4b9d-be68-e195e539e831 Aug 26 08:59:27.448356 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.448356 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-478c2ee9-240e-4946-842b-212aed66223f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Returning 400 to user: Invalid volume: volume 07a41118-eca1-4af0-ae2d-8194c2d1d21c is already attached to instances: 0695da3e-654d-4b9d-be68-e195e539e831 {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:59:27.448356 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-478c2ee9-240e-4946-842b-212aed66223f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "POST /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127412 Aug 26 08:59:27.448356 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 470/940] 10.222.0.71 () {60 vars in 1323 bytes} [Fri Aug 26 08:59:27 2022] POST /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments => generated 174 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 08:59:27.523425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-bb4cb776-6836-4150-a842-29f153b09142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:27.524290 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-bb4cb776-6836-4150-a842-29f153b09142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:27.534201 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bb4cb776-6836-4150-a842-29f153b09142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:27.539751 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bb4cb776-6836-4150-a842-29f153b09142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:27.539751 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bb4cb776-6836-4150-a842-29f153b09142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:27.539751 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bb4cb776-6836-4150-a842-29f153b09142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:27.539751 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bb4cb776-6836-4150-a842-29f153b09142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:27.541889 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bb4cb776-6836-4150-a842-29f153b09142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:27.541889 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:27.591378 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5d9907c6-2b42-43b9-94bd-63366a04aef0 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f136c1429d0>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:27.629727 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-5d9907c6-2b42-43b9-94bd-63366a04aef0 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] HTTP exception thrown: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.637566 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-bb4cb776-6836-4150-a842-29f153b09142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'services' on Instance uuid 0695da3e-654d-4b9d-be68-e195e539e831 {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5d9907c6-2b42-43b9-94bd-63366a04aef0 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Request method failure captured: Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89 HTTP/1.1 Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCItm0QsHbZMMGk27WOU08tbwRo29jrvk9P92DLNaeJELAnj_s0iRZElAZLvcluhj6Uh2fiQZdhSs7wOz-G0Yk5svX1RYutSOUVpkK8agwzANkHl1-VINmc4sI_frCXTneAlJZjTZPZ-CWmzdqFyMAmT2bg3hW96k_erCW19bclb8FqE Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: f7e75f903f7942dda7df96c0300baf46 Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1200334186 Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 08:59:27.640505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 08:59:27.642180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f7e75f903f7942dda7df96c0300baf46", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f7e75f903f7942dda7df96c0300baf46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f7e75f903f7942dda7df96c0300baf46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f7e75f903f7942dda7df96c0300baf46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:59:27.642180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1200334186 Aug 26 08:59:27.642180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: f7e75f903f7942dda7df96c0300baf46 Aug 26 08:59:27.642180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1200334186 Aug 26 08:59:27.642180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-VolumesSnapshotsTestJSON-1200334186-project Aug 26 08:59:27.642180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 08:59:27.642180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 08:59:27.642180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 71b7df583d74468a8a7ae47f0190c220 Aug 26 08:59:27.642180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1200334186-project Aug 26 08:59:27.642180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: Aug 26 08:59:27.642180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.642180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': 'e9b2ebab-fe69-404f-803c-95ce899bfd89'} Aug 26 08:59:27.642180 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. (HTTP 404) (Request-ID: req-1fb2d7c6-d724-4cbd-a354-b02500a6c8c2) Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:27.644760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 08:59:27.645954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 08:59:27.647267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:59:27.648466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.648466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.648466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:27.648466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.648466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.648466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:27.648466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:27.648466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:59:27.648466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:59:27.648466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.648466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.648466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5d9907c6-2b42-43b9-94bd-63366a04aef0 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Returning 404 to user: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:59:27.648466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5d9907c6-2b42-43b9-94bd-63366a04aef0 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89" status: 404 len: 109 microversion: 2.1 time: 0.055962 Aug 26 08:59:27.648466 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 471/941] 10.222.0.71 () {58 vars in 1245 bytes} [Fri Aug 26 08:59:27 2022] GET /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:59:27.660421 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7a4d989b-6810-4a32-9758-c10688889e79 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f136c04f280>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:27.698494 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-7a4d989b-6810-4a32-9758-c10688889e79 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] HTTP exception thrown: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7a4d989b-6810-4a32-9758-c10688889e79 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Request method failure captured: Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: DELETE /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89 HTTP/1.1 Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCItm0QsHbZMMGk27WOU08tbwRo29jrvk9P92DLNaeJELAnj_s0iRZElAZLvcluhj6Uh2fiQZdhSs7wOz-G0Yk5svX1RYutSOUVpkK8agwzANkHl1-VINmc4sI_frCXTneAlJZjTZPZ-CWmzdqFyMAmT2bg3hW96k_erCW19bclb8FqE Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: f7e75f903f7942dda7df96c0300baf46 Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1200334186 Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 08:59:27.702239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 08:59:27.704552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f7e75f903f7942dda7df96c0300baf46", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f7e75f903f7942dda7df96c0300baf46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f7e75f903f7942dda7df96c0300baf46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f7e75f903f7942dda7df96c0300baf46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:59:27.704552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1200334186 Aug 26 08:59:27.704552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: f7e75f903f7942dda7df96c0300baf46 Aug 26 08:59:27.704552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1200334186 Aug 26 08:59:27.704552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-VolumesSnapshotsTestJSON-1200334186-project Aug 26 08:59:27.704552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 08:59:27.704552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 08:59:27.704552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 71b7df583d74468a8a7ae47f0190c220 Aug 26 08:59:27.704552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1200334186-project Aug 26 08:59:27.704552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: Aug 26 08:59:27.704552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.704552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': 'e9b2ebab-fe69-404f-803c-95ce899bfd89'} Aug 26 08:59:27.704552 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. (HTTP 404) (Request-ID: req-02521548-6774-4355-8aab-2fbf216d0cb6) Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:27.705513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 08:59:27.706912 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 08:59:27.708423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:59:27.710089 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.710089 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.710089 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:27.710089 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.710089 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.710089 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:27.710089 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:27.710089 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:59:27.710089 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:59:27.710089 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.710089 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.711023 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7a4d989b-6810-4a32-9758-c10688889e79 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Returning 404 to user: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:59:27.712362 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7a4d989b-6810-4a32-9758-c10688889e79 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89" status: 404 len: 109 microversion: 2.1 time: 0.056178 Aug 26 08:59:27.716780 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 472/942] 10.222.0.71 () {58 vars in 1248 bytes} [Fri Aug 26 08:59:27 2022] DELETE /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 08:59:27.721313 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-51e49bf1-8310-4b89-90c4-baae954f387d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:27.722756 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-51e49bf1-8310-4b89-90c4-baae954f387d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:27.734359 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-51e49bf1-8310-4b89-90c4-baae954f387d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:27.735371 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-51e49bf1-8310-4b89-90c4-baae954f387d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:27.737536 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-51e49bf1-8310-4b89-90c4-baae954f387d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:27.738015 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-51e49bf1-8310-4b89-90c4-baae954f387d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:27.738881 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-51e49bf1-8310-4b89-90c4-baae954f387d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:27.739890 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-51e49bf1-8310-4b89-90c4-baae954f387d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:27.769507 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-bb4cb776-6836-4150-a842-29f153b09142 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments/07a41118-eca1-4af0-ae2d-8194c2d1d21c" status: 202 len: 0 microversion: 2.1 time: 0.253225 Aug 26 08:59:27.770437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 471/943] 10.222.0.71 () {58 vars in 1416 bytes} [Fri Aug 26 08:59:27 2022] DELETE /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments/07a41118-eca1-4af0-ae2d-8194c2d1d21c => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:59:27.775771 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d8f25d3e-ccde-4989-9b17-68521a689fc4 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Calling method '.version_select at 0x7f1367ebfca0>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:27.818202 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-d8f25d3e-ccde-4989-9b17-68521a689fc4 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] HTTP exception thrown: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d8f25d3e-ccde-4989-9b17-68521a689fc4 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Request method failure captured: Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89 HTTP/1.1 Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCItm0QsHbZMMGk27WOU08tbwRo29jrvk9P92DLNaeJELAnj_s0iRZElAZLvcluhj6Uh2fiQZdhSs7wOz-G0Yk5svX1RYutSOUVpkK8agwzANkHl1-VINmc4sI_frCXTneAlJZjTZPZ-CWmzdqFyMAmT2bg3hW96k_erCW19bclb8FqE Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: f7e75f903f7942dda7df96c0300baf46 Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1200334186 Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 08:59:27.819891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 08:59:27.822173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f7e75f903f7942dda7df96c0300baf46", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f7e75f903f7942dda7df96c0300baf46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f7e75f903f7942dda7df96c0300baf46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f7e75f903f7942dda7df96c0300baf46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:59:27.822173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1200334186 Aug 26 08:59:27.822173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: f7e75f903f7942dda7df96c0300baf46 Aug 26 08:59:27.822173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1200334186 Aug 26 08:59:27.822173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-VolumesSnapshotsTestJSON-1200334186-project Aug 26 08:59:27.822173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 08:59:27.822173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 08:59:27.822173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 71b7df583d74468a8a7ae47f0190c220 Aug 26 08:59:27.822173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1200334186-project Aug 26 08:59:27.822173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: Aug 26 08:59:27.822173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.822173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': 'e9b2ebab-fe69-404f-803c-95ce899bfd89'} Aug 26 08:59:27.822173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. (HTTP 404) (Request-ID: req-380e1fa8-6aed-4841-b02f-8a74fdb84fbc) Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:27.823617 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 08:59:27.825702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 08:59:27.829561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:59:27.835992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.835992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.835992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:27.835992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.835992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:27.835992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:27.835992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:27.835992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:59:27.835992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:59:27.835992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. Aug 26 08:59:27.835992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:27.835992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d8f25d3e-ccde-4989-9b17-68521a689fc4 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] Returning 404 to user: Volume e9b2ebab-fe69-404f-803c-95ce899bfd89 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:59:27.835992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d8f25d3e-ccde-4989-9b17-68521a689fc4 tempest-VolumesSnapshotsTestJSON-1200334186 tempest-VolumesSnapshotsTestJSON-1200334186-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89" status: 404 len: 109 microversion: 2.1 time: 0.050761 Aug 26 08:59:27.835992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 472/944] 10.222.0.71 () {58 vars in 1245 bytes} [Fri Aug 26 08:59:27 2022] GET /compute/v2.1/os-volumes/e9b2ebab-fe69-404f-803c-95ce899bfd89 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:59:27.839586 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-17cd9433-8b7f-4bda-ba67-07d7c88a0596 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:27.839586 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-17cd9433-8b7f-4bda-ba67-07d7c88a0596 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:27.845825 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-17cd9433-8b7f-4bda-ba67-07d7c88a0596 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:27.846451 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-17cd9433-8b7f-4bda-ba67-07d7c88a0596 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:27.847706 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-17cd9433-8b7f-4bda-ba67-07d7c88a0596 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:27.848644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-17cd9433-8b7f-4bda-ba67-07d7c88a0596 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:27.849961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-17cd9433-8b7f-4bda-ba67-07d7c88a0596 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:27.850521 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-17cd9433-8b7f-4bda-ba67-07d7c88a0596 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:27.902183 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-17cd9433-8b7f-4bda-ba67-07d7c88a0596 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075979 Aug 26 08:59:27.902942 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 473/945] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:27 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:27.928093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-51e49bf1-8310-4b89-90c4-baae954f387d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:27.940877 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-51e49bf1-8310-4b89-90c4-baae954f387d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:27.943494 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-51e49bf1-8310-4b89-90c4-baae954f387d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:27.945946 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-51e49bf1-8310-4b89-90c4-baae954f387d tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1720 microversion: 2.20 time: 0.231387 Aug 26 08:59:27.947245 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 473/946] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:27 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1720 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:28.689064 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-f811460f-ba28-470d-8d10-70bc4d8ba93d req-e9275fa2-8878-47a2-8e5e-1e4ce00f627a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbfe1e03-de30-4198-9a4d-a96708dbb98b", "name": "network-vif-unplugged", "status": "completed", "tag": "57b16be7-70f7-4545-b557-e106d767a915"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:28.709919 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-f811460f-ba28-470d-8d10-70bc4d8ba93d req-e9275fa2-8878-47a2-8e5e-1e4ce00f627a service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:28.710262 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-f811460f-ba28-470d-8d10-70bc4d8ba93d req-e9275fa2-8878-47a2-8e5e-1e4ce00f627a service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:28.710686 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-f811460f-ba28-470d-8d10-70bc4d8ba93d req-e9275fa2-8878-47a2-8e5e-1e4ce00f627a service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:28.725896 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-f811460f-ba28-470d-8d10-70bc4d8ba93d req-e9275fa2-8878-47a2-8e5e-1e4ce00f627a service nova] Creating event network-vif-unplugged:57b16be7-70f7-4545-b557-e106d767a915 for instance cbfe1e03-de30-4198-9a4d-a96708dbb98b on hv-cinder-85236 Aug 26 08:59:28.731677 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-f811460f-ba28-470d-8d10-70bc4d8ba93d req-e9275fa2-8878-47a2-8e5e-1e4ce00f627a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047690 Aug 26 08:59:28.732876 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 474/947] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:28.915436 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-af793385-f1c9-40e0-8f8f-02c2cd37161f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:28.918740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-af793385-f1c9-40e0-8f8f-02c2cd37161f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:28.921942 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:28.928380 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af793385-f1c9-40e0-8f8f-02c2cd37161f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:28.929196 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af793385-f1c9-40e0-8f8f-02c2cd37161f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:28.929853 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af793385-f1c9-40e0-8f8f-02c2cd37161f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:28.930916 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af793385-f1c9-40e0-8f8f-02c2cd37161f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:28.931547 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af793385-f1c9-40e0-8f8f-02c2cd37161f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:28.932127 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af793385-f1c9-40e0-8f8f-02c2cd37161f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:28.970660 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d3b47c22-4db0-416b-a37c-a8cbf4d8eec3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:28.971563 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d3b47c22-4db0-416b-a37c-a8cbf4d8eec3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:28.990239 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-af793385-f1c9-40e0-8f8f-02c2cd37161f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079021 Aug 26 08:59:28.992038 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 474/948] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:28 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:29.004422 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d3b47c22-4db0-416b-a37c-a8cbf4d8eec3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:29.005543 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d3b47c22-4db0-416b-a37c-a8cbf4d8eec3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:29.006391 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d3b47c22-4db0-416b-a37c-a8cbf4d8eec3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:29.007760 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d3b47c22-4db0-416b-a37c-a8cbf4d8eec3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:29.008736 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d3b47c22-4db0-416b-a37c-a8cbf4d8eec3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:29.009635 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d3b47c22-4db0-416b-a37c-a8cbf4d8eec3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:29.312629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d3b47c22-4db0-416b-a37c-a8cbf4d8eec3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:29.327788 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d3b47c22-4db0-416b-a37c-a8cbf4d8eec3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:29.329511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d3b47c22-4db0-416b-a37c-a8cbf4d8eec3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:29.330830 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d3b47c22-4db0-416b-a37c-a8cbf4d8eec3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1723 microversion: 2.20 time: 0.364774 Aug 26 08:59:29.331900 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 475/949] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:28 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1723 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:59:29.355772 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a9be5c43-6f16-4d9a-9222-d3ee13bca942 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d019c3a6-efff-4603-b864-5f05408280f1"}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:29.359766 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a9be5c43-6f16-4d9a-9222-d3ee13bca942 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:29.379405 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a9be5c43-6f16-4d9a-9222-d3ee13bca942 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:29.379968 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a9be5c43-6f16-4d9a-9222-d3ee13bca942 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:29.380689 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a9be5c43-6f16-4d9a-9222-d3ee13bca942 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:29.381681 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a9be5c43-6f16-4d9a-9222-d3ee13bca942 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:29.382237 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a9be5c43-6f16-4d9a-9222-d3ee13bca942 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:29.382741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a9be5c43-6f16-4d9a-9222-d3ee13bca942 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:29.779113 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a9be5c43-6f16-4d9a-9222-d3ee13bca942 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "POST /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.429699 Aug 26 08:59:29.780079 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 475/950] 10.222.0.71 () {62 vars in 1364 bytes} [Fri Aug 26 08:59:29 2022] POST /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b/os-volume_attachments => generated 188 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 08:59:29.942477 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-cb2f2b40-3125-4cee-b2a0-054a0e37a900 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:29.945468 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-cb2f2b40-3125-4cee-b2a0-054a0e37a900 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:29.950787 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:29.961492 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cb2f2b40-3125-4cee-b2a0-054a0e37a900 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:29.962777 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cb2f2b40-3125-4cee-b2a0-054a0e37a900 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:29.963557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cb2f2b40-3125-4cee-b2a0-054a0e37a900 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:29.964694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cb2f2b40-3125-4cee-b2a0-054a0e37a900 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:29.965982 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cb2f2b40-3125-4cee-b2a0-054a0e37a900 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:29.967060 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cb2f2b40-3125-4cee-b2a0-054a0e37a900 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:30.005351 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-898f5a4a-1e27-4590-a62c-2fb8c6990f93 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:30.009232 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-898f5a4a-1e27-4590-a62c-2fb8c6990f93 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:30.025966 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-898f5a4a-1e27-4590-a62c-2fb8c6990f93 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:30.028956 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-898f5a4a-1e27-4590-a62c-2fb8c6990f93 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:30.030235 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-898f5a4a-1e27-4590-a62c-2fb8c6990f93 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:30.043042 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-898f5a4a-1e27-4590-a62c-2fb8c6990f93 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:30.045504 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-898f5a4a-1e27-4590-a62c-2fb8c6990f93 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:30.046474 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-898f5a4a-1e27-4590-a62c-2fb8c6990f93 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:30.118202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-898f5a4a-1e27-4590-a62c-2fb8c6990f93 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117445 Aug 26 08:59:30.119805 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 476/951] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:29 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:59:30.430545 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-cb2f2b40-3125-4cee-b2a0-054a0e37a900 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "DELETE /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b/os-volume_attachments/d019c3a6-efff-4603-b864-5f05408280f1" status: 202 len: 0 microversion: 2.20 time: 0.494913 Aug 26 08:59:30.432650 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 476/952] 10.222.0.71 () {60 vars in 1457 bytes} [Fri Aug 26 08:59:29 2022] DELETE /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b/os-volume_attachments/d019c3a6-efff-4603-b864-5f05408280f1 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:59:30.517653 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-aa284fa9-efe9-410d-9c39-bfc2ed95ce07 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:30.518538 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-aa284fa9-efe9-410d-9c39-bfc2ed95ce07 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:30.525594 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa284fa9-efe9-410d-9c39-bfc2ed95ce07 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:30.526135 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa284fa9-efe9-410d-9c39-bfc2ed95ce07 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:30.526567 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa284fa9-efe9-410d-9c39-bfc2ed95ce07 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:30.527614 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa284fa9-efe9-410d-9c39-bfc2ed95ce07 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:30.527883 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa284fa9-efe9-410d-9c39-bfc2ed95ce07 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:30.528314 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa284fa9-efe9-410d-9c39-bfc2ed95ce07 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:30.596192 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-aa284fa9-efe9-410d-9c39-bfc2ed95ce07 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132218) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 08:59:30.688950 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-aa284fa9-efe9-410d-9c39-bfc2ed95ce07 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "POST /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b/action" status: 202 len: 0 microversion: 2.20 time: 0.175293 Aug 26 08:59:30.691252 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 477/953] 10.222.0.71 () {62 vars in 1319 bytes} [Fri Aug 26 08:59:30 2022] POST /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:59:30.699453 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6b1d6f1c-2160-49d6-80ac-807bbb763539 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:30.700060 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6b1d6f1c-2160-49d6-80ac-807bbb763539 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:30.708174 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b1d6f1c-2160-49d6-80ac-807bbb763539 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:30.708669 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b1d6f1c-2160-49d6-80ac-807bbb763539 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:30.708975 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b1d6f1c-2160-49d6-80ac-807bbb763539 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:30.709679 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b1d6f1c-2160-49d6-80ac-807bbb763539 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:30.710125 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b1d6f1c-2160-49d6-80ac-807bbb763539 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:30.710542 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b1d6f1c-2160-49d6-80ac-807bbb763539 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:30.946669 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6b1d6f1c-2160-49d6-80ac-807bbb763539 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:30.964801 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6b1d6f1c-2160-49d6-80ac-807bbb763539 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:30.966695 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6b1d6f1c-2160-49d6-80ac-807bbb763539 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:30.968494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6b1d6f1c-2160-49d6-80ac-807bbb763539 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1671 microversion: 2.20 time: 0.274158 Aug 26 08:59:30.985388 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 477/954] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:30 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1671 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:59:31.133563 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9651f4cf-3e04-449b-954f-a3c850afa96a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:31.136599 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9651f4cf-3e04-449b-954f-a3c850afa96a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:31.144469 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9651f4cf-3e04-449b-954f-a3c850afa96a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:31.145503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9651f4cf-3e04-449b-954f-a3c850afa96a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:31.146220 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9651f4cf-3e04-449b-954f-a3c850afa96a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:31.147905 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9651f4cf-3e04-449b-954f-a3c850afa96a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:31.149203 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9651f4cf-3e04-449b-954f-a3c850afa96a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:31.149843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9651f4cf-3e04-449b-954f-a3c850afa96a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:31.191225 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9651f4cf-3e04-449b-954f-a3c850afa96a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062918 Aug 26 08:59:31.192089 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 478/955] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:31 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:59:31.997212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-751fa0c9-dd21-4676-8cea-096f95884443 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:31.997982 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-751fa0c9-dd21-4676-8cea-096f95884443 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:32.009503 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-751fa0c9-dd21-4676-8cea-096f95884443 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:32.010454 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-751fa0c9-dd21-4676-8cea-096f95884443 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:32.011321 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-751fa0c9-dd21-4676-8cea-096f95884443 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:32.012713 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-751fa0c9-dd21-4676-8cea-096f95884443 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:32.013284 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-751fa0c9-dd21-4676-8cea-096f95884443 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:32.015092 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-751fa0c9-dd21-4676-8cea-096f95884443 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:32.210410 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7eeab978-e770-471f-b737-03a67e2d1aeb tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:32.213874 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-7eeab978-e770-471f-b737-03a67e2d1aeb tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:32.231932 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7eeab978-e770-471f-b737-03a67e2d1aeb tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:32.232443 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7eeab978-e770-471f-b737-03a67e2d1aeb tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:32.232881 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7eeab978-e770-471f-b737-03a67e2d1aeb tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:32.233680 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7eeab978-e770-471f-b737-03a67e2d1aeb tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:32.234135 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7eeab978-e770-471f-b737-03a67e2d1aeb tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:32.234658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7eeab978-e770-471f-b737-03a67e2d1aeb tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:32.266596 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:32.284709 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7eeab978-e770-471f-b737-03a67e2d1aeb tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079942 Aug 26 08:59:32.290447 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 479/956] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:32 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:32.381454 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-751fa0c9-dd21-4676-8cea-096f95884443 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:32.390210 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-751fa0c9-dd21-4676-8cea-096f95884443 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:32.391930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-751fa0c9-dd21-4676-8cea-096f95884443 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:32.393128 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-751fa0c9-dd21-4676-8cea-096f95884443 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1671 microversion: 2.20 time: 0.403784 Aug 26 08:59:32.394086 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 478/957] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:31 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1671 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:33.298616 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-782b1a99-7080-4476-93be-a33e5e34aa57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:33.301030 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-782b1a99-7080-4476-93be-a33e5e34aa57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:33.309756 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-782b1a99-7080-4476-93be-a33e5e34aa57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:33.310359 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-782b1a99-7080-4476-93be-a33e5e34aa57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:33.310801 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-782b1a99-7080-4476-93be-a33e5e34aa57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:33.311549 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-782b1a99-7080-4476-93be-a33e5e34aa57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:33.311997 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-782b1a99-7080-4476-93be-a33e5e34aa57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:33.312445 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-782b1a99-7080-4476-93be-a33e5e34aa57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:33.370761 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-782b1a99-7080-4476-93be-a33e5e34aa57 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076751 Aug 26 08:59:33.372059 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 480/958] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:33 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:33.428756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e4e3d0d5-0c36-4c76-91d7-94afb375d40a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:33.432252 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e4e3d0d5-0c36-4c76-91d7-94afb375d40a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:33.447502 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4e3d0d5-0c36-4c76-91d7-94afb375d40a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:33.448692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4e3d0d5-0c36-4c76-91d7-94afb375d40a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:33.449691 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4e3d0d5-0c36-4c76-91d7-94afb375d40a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:33.453249 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4e3d0d5-0c36-4c76-91d7-94afb375d40a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:33.455024 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4e3d0d5-0c36-4c76-91d7-94afb375d40a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:33.456257 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e4e3d0d5-0c36-4c76-91d7-94afb375d40a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:33.762774 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e4e3d0d5-0c36-4c76-91d7-94afb375d40a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:33.779409 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e4e3d0d5-0c36-4c76-91d7-94afb375d40a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:33.782455 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e4e3d0d5-0c36-4c76-91d7-94afb375d40a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:33.784292 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e4e3d0d5-0c36-4c76-91d7-94afb375d40a tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.365935 Aug 26 08:59:33.800570 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 479/959] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:33 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:34.387128 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-43b12790-3e2b-4656-a02a-b28b26f39c80 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:34.390156 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-43b12790-3e2b-4656-a02a-b28b26f39c80 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:34.398015 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-43b12790-3e2b-4656-a02a-b28b26f39c80 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:34.399159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-43b12790-3e2b-4656-a02a-b28b26f39c80 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:34.399777 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-43b12790-3e2b-4656-a02a-b28b26f39c80 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:34.400504 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-43b12790-3e2b-4656-a02a-b28b26f39c80 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:34.401172 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-43b12790-3e2b-4656-a02a-b28b26f39c80 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:34.401599 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-43b12790-3e2b-4656-a02a-b28b26f39c80 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:34.435698 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-43b12790-3e2b-4656-a02a-b28b26f39c80 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053130 Aug 26 08:59:34.436959 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 481/960] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:34 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:34.810622 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8041b7e4-266a-4011-be58-51f25b88a9e0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:34.811411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8041b7e4-266a-4011-be58-51f25b88a9e0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:34.818822 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8041b7e4-266a-4011-be58-51f25b88a9e0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:34.819721 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8041b7e4-266a-4011-be58-51f25b88a9e0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:34.820405 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8041b7e4-266a-4011-be58-51f25b88a9e0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:34.821358 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8041b7e4-266a-4011-be58-51f25b88a9e0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:34.822024 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8041b7e4-266a-4011-be58-51f25b88a9e0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:34.822660 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8041b7e4-266a-4011-be58-51f25b88a9e0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:35.166222 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8041b7e4-266a-4011-be58-51f25b88a9e0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:35.233511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8041b7e4-266a-4011-be58-51f25b88a9e0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:35.240822 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8041b7e4-266a-4011-be58-51f25b88a9e0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:35.253865 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8041b7e4-266a-4011-be58-51f25b88a9e0 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.445384 Aug 26 08:59:35.275356 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 480/961] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:34 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:35.461346 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5bdc0097-a6a2-4e75-8e8c-58e8807a6f0a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:35.465059 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5bdc0097-a6a2-4e75-8e8c-58e8807a6f0a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:35.483794 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5bdc0097-a6a2-4e75-8e8c-58e8807a6f0a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:35.486970 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5bdc0097-a6a2-4e75-8e8c-58e8807a6f0a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:35.489394 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5bdc0097-a6a2-4e75-8e8c-58e8807a6f0a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:35.490387 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5bdc0097-a6a2-4e75-8e8c-58e8807a6f0a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:35.491645 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5bdc0097-a6a2-4e75-8e8c-58e8807a6f0a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:35.492503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5bdc0097-a6a2-4e75-8e8c-58e8807a6f0a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:35.563778 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5bdc0097-a6a2-4e75-8e8c-58e8807a6f0a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116897 Aug 26 08:59:35.569583 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 482/962] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:35 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:35.893054 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ed69d6a8-3112-4b01-b085-e4c6e5b317c8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:35.897116 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ed69d6a8-3112-4b01-b085-e4c6e5b317c8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:35.907920 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ed69d6a8-3112-4b01-b085-e4c6e5b317c8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:35.908961 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ed69d6a8-3112-4b01-b085-e4c6e5b317c8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:35.909575 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ed69d6a8-3112-4b01-b085-e4c6e5b317c8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:35.911232 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ed69d6a8-3112-4b01-b085-e4c6e5b317c8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:35.912035 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ed69d6a8-3112-4b01-b085-e4c6e5b317c8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:35.912697 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ed69d6a8-3112-4b01-b085-e4c6e5b317c8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:35.982531 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ed69d6a8-3112-4b01-b085-e4c6e5b317c8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098629 Aug 26 08:59:35.988920 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 481/963] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:35 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:35.995393 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-800d174e-314a-418a-af37-eb4a873d083c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:35.996344 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-800d174e-314a-418a-af37-eb4a873d083c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:36.006417 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-800d174e-314a-418a-af37-eb4a873d083c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:36.006970 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-800d174e-314a-418a-af37-eb4a873d083c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:36.007387 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-800d174e-314a-418a-af37-eb4a873d083c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:36.008133 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-800d174e-314a-418a-af37-eb4a873d083c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:36.008578 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-800d174e-314a-418a-af37-eb4a873d083c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:36.009004 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-800d174e-314a-418a-af37-eb4a873d083c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:36.051358 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-800d174e-314a-418a-af37-eb4a873d083c tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments/9d3ee2db-0482-4d9a-9ae3-0dc019f68d64" status: 200 len: 194 microversion: 2.1 time: 0.060709 Aug 26 08:59:36.057404 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 483/964] 10.222.0.71 () {58 vars in 1413 bytes} [Fri Aug 26 08:59:35 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments/9d3ee2db-0482-4d9a-9ae3-0dc019f68d64 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:36.300818 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-68ada6e4-a4b0-4175-9485-78e87bbac559 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:36.301877 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-68ada6e4-a4b0-4175-9485-78e87bbac559 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:36.316720 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-68ada6e4-a4b0-4175-9485-78e87bbac559 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:36.318815 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-68ada6e4-a4b0-4175-9485-78e87bbac559 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:36.320113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-68ada6e4-a4b0-4175-9485-78e87bbac559 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:36.323296 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-68ada6e4-a4b0-4175-9485-78e87bbac559 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:36.325515 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-68ada6e4-a4b0-4175-9485-78e87bbac559 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:36.327055 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-68ada6e4-a4b0-4175-9485-78e87bbac559 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:36.580184 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a48e4ca9-3906-4519-8d01-165aef4b72a7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:36.583418 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a48e4ca9-3906-4519-8d01-165aef4b72a7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:36.623363 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a48e4ca9-3906-4519-8d01-165aef4b72a7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:36.623861 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a48e4ca9-3906-4519-8d01-165aef4b72a7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:36.624476 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a48e4ca9-3906-4519-8d01-165aef4b72a7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:36.629365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a48e4ca9-3906-4519-8d01-165aef4b72a7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:36.630274 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a48e4ca9-3906-4519-8d01-165aef4b72a7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:36.631039 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a48e4ca9-3906-4519-8d01-165aef4b72a7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:36.728863 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a48e4ca9-3906-4519-8d01-165aef4b72a7 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.153878 Aug 26 08:59:36.739067 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 484/965] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:36 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831/os-volume_attachments => generated 25 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 08:59:36.784271 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-68ada6e4-a4b0-4175-9485-78e87bbac559 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:36.831881 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-68ada6e4-a4b0-4175-9485-78e87bbac559 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:36.839825 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-68ada6e4-a4b0-4175-9485-78e87bbac559 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:36.851286 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-68ada6e4-a4b0-4175-9485-78e87bbac559 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.555279 Aug 26 08:59:36.863715 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 482/966] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:36 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:59:36.902458 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1848a13a-ff4f-485e-b85c-0425a9894a27 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:36.903521 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1848a13a-ff4f-485e-b85c-0425a9894a27 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:36.927757 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1848a13a-ff4f-485e-b85c-0425a9894a27 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:36.928724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1848a13a-ff4f-485e-b85c-0425a9894a27 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:36.931113 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1848a13a-ff4f-485e-b85c-0425a9894a27 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:36.935189 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1848a13a-ff4f-485e-b85c-0425a9894a27 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:36.940016 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1848a13a-ff4f-485e-b85c-0425a9894a27 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:36.941895 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1848a13a-ff4f-485e-b85c-0425a9894a27 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:37.025008 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1848a13a-ff4f-485e-b85c-0425a9894a27 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 08:59:37.198971 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1848a13a-ff4f-485e-b85c-0425a9894a27 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 204 len: 0 microversion: 2.1 time: 0.302026 Aug 26 08:59:37.207284 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 485/967] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 08:59:36 2022] DELETE /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 08:59:37.215404 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-43db19c9-661c-40b8-87a0-e556d9292677 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:37.215404 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-43db19c9-661c-40b8-87a0-e556d9292677 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:37.231431 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43db19c9-661c-40b8-87a0-e556d9292677 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:37.233569 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43db19c9-661c-40b8-87a0-e556d9292677 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:37.237685 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43db19c9-661c-40b8-87a0-e556d9292677 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:37.238681 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43db19c9-661c-40b8-87a0-e556d9292677 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:37.239213 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43db19c9-661c-40b8-87a0-e556d9292677 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:37.239661 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43db19c9-661c-40b8-87a0-e556d9292677 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:37.618114 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-43db19c9-661c-40b8-87a0-e556d9292677 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:37.630001 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-43db19c9-661c-40b8-87a0-e556d9292677 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1680 microversion: 2.1 time: 0.421238 Aug 26 08:59:37.631440 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 483/968] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:37 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1680 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:59:37.847384 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-785b2b4b-6b59-4053-98eb-9f5045dee83b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cccadab1-0206-4e85-aaa8-2741631efd09"}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:37.850972 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-785b2b4b-6b59-4053-98eb-9f5045dee83b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:37.858664 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-785b2b4b-6b59-4053-98eb-9f5045dee83b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:37.859560 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-785b2b4b-6b59-4053-98eb-9f5045dee83b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:37.860213 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-785b2b4b-6b59-4053-98eb-9f5045dee83b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:37.861218 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-785b2b4b-6b59-4053-98eb-9f5045dee83b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:37.861884 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-785b2b4b-6b59-4053-98eb-9f5045dee83b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:37.862528 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-785b2b4b-6b59-4053-98eb-9f5045dee83b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:37.897400 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d4a62cc0-d0ac-4da2-94d2-909b602c4abb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:37.898261 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d4a62cc0-d0ac-4da2-94d2-909b602c4abb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:37.930533 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d4a62cc0-d0ac-4da2-94d2-909b602c4abb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:37.931643 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d4a62cc0-d0ac-4da2-94d2-909b602c4abb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:37.932090 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d4a62cc0-d0ac-4da2-94d2-909b602c4abb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:37.933606 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d4a62cc0-d0ac-4da2-94d2-909b602c4abb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:37.934239 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d4a62cc0-d0ac-4da2-94d2-909b602c4abb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:37.935017 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d4a62cc0-d0ac-4da2-94d2-909b602c4abb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:38.257578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d4a62cc0-d0ac-4da2-94d2-909b602c4abb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:38.267355 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d4a62cc0-d0ac-4da2-94d2-909b602c4abb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:38.268934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d4a62cc0-d0ac-4da2-94d2-909b602c4abb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:38.270857 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d4a62cc0-d0ac-4da2-94d2-909b602c4abb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.381824 Aug 26 08:59:38.271460 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 484/969] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:37 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:38.653502 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b9ddd629-d99f-43ef-9132-0fbf24082349 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:38.654538 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b9ddd629-d99f-43ef-9132-0fbf24082349 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:38.694379 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9ddd629-d99f-43ef-9132-0fbf24082349 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:38.696835 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9ddd629-d99f-43ef-9132-0fbf24082349 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:38.697744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9ddd629-d99f-43ef-9132-0fbf24082349 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:38.702662 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9ddd629-d99f-43ef-9132-0fbf24082349 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:38.704144 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9ddd629-d99f-43ef-9132-0fbf24082349 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:38.711101 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b9ddd629-d99f-43ef-9132-0fbf24082349 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:39.145044 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b9ddd629-d99f-43ef-9132-0fbf24082349 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:39.158866 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b9ddd629-d99f-43ef-9132-0fbf24082349 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1680 microversion: 2.1 time: 0.510305 Aug 26 08:59:39.160444 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 485/970] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:38 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1680 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:39.298792 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-94f32733-3cbd-4103-b72b-8154763861ab tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:39.299531 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-94f32733-3cbd-4103-b72b-8154763861ab tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:39.312495 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-94f32733-3cbd-4103-b72b-8154763861ab tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:39.313035 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-94f32733-3cbd-4103-b72b-8154763861ab tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:39.313653 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-94f32733-3cbd-4103-b72b-8154763861ab tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:39.314462 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-94f32733-3cbd-4103-b72b-8154763861ab tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:39.314984 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-94f32733-3cbd-4103-b72b-8154763861ab tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:39.315464 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-94f32733-3cbd-4103-b72b-8154763861ab tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:39.334153 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:39.769288 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-94f32733-3cbd-4103-b72b-8154763861ab tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:39.812100 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-94f32733-3cbd-4103-b72b-8154763861ab tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:39.815850 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-94f32733-3cbd-4103-b72b-8154763861ab tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:39.821697 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-94f32733-3cbd-4103-b72b-8154763861ab tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.527303 Aug 26 08:59:39.832765 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 486/971] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:39 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:39.854610 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-785b2b4b-6b59-4053-98eb-9f5045dee83b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "POST /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.013647 Aug 26 08:59:39.862546 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 486/972] 10.222.0.71 () {60 vars in 1323 bytes} [Fri Aug 26 08:59:37 2022] POST /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments => generated 194 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:40.193858 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4412098f-c685-44c4-8a6f-cfb49db82840 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:40.197549 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4412098f-c685-44c4-8a6f-cfb49db82840 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:40.237131 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4412098f-c685-44c4-8a6f-cfb49db82840 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:40.238983 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4412098f-c685-44c4-8a6f-cfb49db82840 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:40.240116 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4412098f-c685-44c4-8a6f-cfb49db82840 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:40.242582 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4412098f-c685-44c4-8a6f-cfb49db82840 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:40.243917 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4412098f-c685-44c4-8a6f-cfb49db82840 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:40.244993 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4412098f-c685-44c4-8a6f-cfb49db82840 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:40.873711 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-052d5690-dc00-4651-8411-f8e7c0e697df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:40.877979 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-052d5690-dc00-4651-8411-f8e7c0e697df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:40.891235 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-052d5690-dc00-4651-8411-f8e7c0e697df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:40.892054 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-052d5690-dc00-4651-8411-f8e7c0e697df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:40.892697 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-052d5690-dc00-4651-8411-f8e7c0e697df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:40.893646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-052d5690-dc00-4651-8411-f8e7c0e697df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:40.894269 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-052d5690-dc00-4651-8411-f8e7c0e697df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:40.894859 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-052d5690-dc00-4651-8411-f8e7c0e697df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:41.178026 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-4412098f-c685-44c4-8a6f-cfb49db82840 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:41.258123 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4412098f-c685-44c4-8a6f-cfb49db82840 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1680 microversion: 2.1 time: 1.077135 Aug 26 08:59:41.261144 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 487/973] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:40 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1680 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:41.380283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-052d5690-dc00-4651-8411-f8e7c0e697df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:41.396299 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-052d5690-dc00-4651-8411-f8e7c0e697df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:41.404502 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-052d5690-dc00-4651-8411-f8e7c0e697df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:41.407357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-052d5690-dc00-4651-8411-f8e7c0e697df tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.547426 Aug 26 08:59:41.408290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 487/974] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:40 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:42.064294 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-b834e2de-619a-43d4-9078-67c42057d50d req-cbaf5a42-7929-49f0-9504-b3d623d36796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0695da3e-654d-4b9d-be68-e195e539e831", "name": "network-vif-deleted", "tag": "ce968e83-b42f-4852-8fd6-c16bf4f5b0ee"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:42.091991 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-b834e2de-619a-43d4-9078-67c42057d50d req-cbaf5a42-7929-49f0-9504-b3d623d36796 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:42.096602 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-b834e2de-619a-43d4-9078-67c42057d50d req-cbaf5a42-7929-49f0-9504-b3d623d36796 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:42.098221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-b834e2de-619a-43d4-9078-67c42057d50d req-cbaf5a42-7929-49f0-9504-b3d623d36796 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:42.152102 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-b834e2de-619a-43d4-9078-67c42057d50d req-cbaf5a42-7929-49f0-9504-b3d623d36796 service nova] Creating event network-vif-deleted:ce968e83-b42f-4852-8fd6-c16bf4f5b0ee for instance 0695da3e-654d-4b9d-be68-e195e539e831 on hv-cinder-85236 Aug 26 08:59:42.159392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-b834e2de-619a-43d4-9078-67c42057d50d req-cbaf5a42-7929-49f0-9504-b3d623d36796 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098659 Aug 26 08:59:42.160683 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 488/975] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:42.285975 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4b034b4c-66bb-48ec-b62a-b1c51581a3b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:42.287251 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4b034b4c-66bb-48ec-b62a-b1c51581a3b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:42.312527 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b034b4c-66bb-48ec-b62a-b1c51581a3b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:42.312778 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b034b4c-66bb-48ec-b62a-b1c51581a3b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:42.313254 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b034b4c-66bb-48ec-b62a-b1c51581a3b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:42.318036 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b034b4c-66bb-48ec-b62a-b1c51581a3b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:42.318302 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b034b4c-66bb-48ec-b62a-b1c51581a3b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:42.321863 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b034b4c-66bb-48ec-b62a-b1c51581a3b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:42.437680 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b4d387f2-9fcb-451d-8249-344cc41ddb89 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:42.438689 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b4d387f2-9fcb-451d-8249-344cc41ddb89 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:42.449701 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4d387f2-9fcb-451d-8249-344cc41ddb89 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:42.450532 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4d387f2-9fcb-451d-8249-344cc41ddb89 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:42.451415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4d387f2-9fcb-451d-8249-344cc41ddb89 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:42.452887 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4d387f2-9fcb-451d-8249-344cc41ddb89 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:42.453532 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4d387f2-9fcb-451d-8249-344cc41ddb89 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:42.454384 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b4d387f2-9fcb-451d-8249-344cc41ddb89 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:42.459977 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b034b4c-66bb-48ec-b62a-b1c51581a3b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:42.461255 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b034b4c-66bb-48ec-b62a-b1c51581a3b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:42.461732 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4b034b4c-66bb-48ec-b62a-b1c51581a3b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:42.462206 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-4b034b4c-66bb-48ec-b62a-b1c51581a3b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'fault' on Instance uuid 0695da3e-654d-4b9d-be68-e195e539e831 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:42.576141 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4b034b4c-66bb-48ec-b62a-b1c51581a3b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:42.593187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4b034b4c-66bb-48ec-b62a-b1c51581a3b2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1331 microversion: 2.1 time: 0.309820 Aug 26 08:59:42.611774 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 488/976] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:42 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1331 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:42.729929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b4d387f2-9fcb-451d-8249-344cc41ddb89 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:42.747248 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b4d387f2-9fcb-451d-8249-344cc41ddb89 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:42.752792 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b4d387f2-9fcb-451d-8249-344cc41ddb89 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:42.754358 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b4d387f2-9fcb-451d-8249-344cc41ddb89 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.321722 Aug 26 08:59:42.776237 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 489/977] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:42 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:59:43.619766 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ccf54ebf-3a67-43f9-8823-b1782e14d148 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:43.621789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ccf54ebf-3a67-43f9-8823-b1782e14d148 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:43.642862 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ccf54ebf-3a67-43f9-8823-b1782e14d148 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:43.644068 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ccf54ebf-3a67-43f9-8823-b1782e14d148 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:43.645214 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ccf54ebf-3a67-43f9-8823-b1782e14d148 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:43.656583 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ccf54ebf-3a67-43f9-8823-b1782e14d148 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:43.658425 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ccf54ebf-3a67-43f9-8823-b1782e14d148 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:43.660869 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ccf54ebf-3a67-43f9-8823-b1782e14d148 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:43.758278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ccf54ebf-3a67-43f9-8823-b1782e14d148 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:43.758278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ccf54ebf-3a67-43f9-8823-b1782e14d148 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:43.758628 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ccf54ebf-3a67-43f9-8823-b1782e14d148 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:43.759044 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-ccf54ebf-3a67-43f9-8823-b1782e14d148 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'fault' on Instance uuid 0695da3e-654d-4b9d-be68-e195e539e831 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:43.782007 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fe9522d4-96a1-4430-b3a8-9ef2b5b99311 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:43.782939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-fe9522d4-96a1-4430-b3a8-9ef2b5b99311 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:43.797918 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fe9522d4-96a1-4430-b3a8-9ef2b5b99311 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:43.798678 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fe9522d4-96a1-4430-b3a8-9ef2b5b99311 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:43.799295 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fe9522d4-96a1-4430-b3a8-9ef2b5b99311 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:43.800177 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fe9522d4-96a1-4430-b3a8-9ef2b5b99311 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:43.812833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fe9522d4-96a1-4430-b3a8-9ef2b5b99311 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:43.815873 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fe9522d4-96a1-4430-b3a8-9ef2b5b99311 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:43.848876 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ccf54ebf-3a67-43f9-8823-b1782e14d148 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:43.857900 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ccf54ebf-3a67-43f9-8823-b1782e14d148 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1331 microversion: 2.1 time: 0.243457 Aug 26 08:59:43.858593 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 489/978] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:43 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1331 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:44.118253 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-fe9522d4-96a1-4430-b3a8-9ef2b5b99311 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:44.130207 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-fe9522d4-96a1-4430-b3a8-9ef2b5b99311 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:44.134750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-fe9522d4-96a1-4430-b3a8-9ef2b5b99311 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:44.136562 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fe9522d4-96a1-4430-b3a8-9ef2b5b99311 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.358654 Aug 26 08:59:44.141441 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 490/979] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:43 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 08:59:44.895092 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f27e132f-d91b-41d5-8e34-9ae3746676b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:44.897338 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f27e132f-d91b-41d5-8e34-9ae3746676b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:44.910921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f27e132f-d91b-41d5-8e34-9ae3746676b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:44.912331 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f27e132f-d91b-41d5-8e34-9ae3746676b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:44.913318 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f27e132f-d91b-41d5-8e34-9ae3746676b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:44.917362 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f27e132f-d91b-41d5-8e34-9ae3746676b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:44.918551 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f27e132f-d91b-41d5-8e34-9ae3746676b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:44.919568 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f27e132f-d91b-41d5-8e34-9ae3746676b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:45.008375 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f27e132f-d91b-41d5-8e34-9ae3746676b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:45.010477 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f27e132f-d91b-41d5-8e34-9ae3746676b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:45.012597 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f27e132f-d91b-41d5-8e34-9ae3746676b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:45.014238 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-f27e132f-d91b-41d5-8e34-9ae3746676b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'fault' on Instance uuid 0695da3e-654d-4b9d-be68-e195e539e831 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:45.095097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f27e132f-d91b-41d5-8e34-9ae3746676b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:45.106127 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f27e132f-d91b-41d5-8e34-9ae3746676b8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1331 microversion: 2.1 time: 0.220354 Aug 26 08:59:45.107202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 490/980] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:44 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1331 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:59:45.174680 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-40da43ac-88f9-4fdd-83b7-ab630955eb83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:45.176534 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-40da43ac-88f9-4fdd-83b7-ab630955eb83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:45.187820 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-40da43ac-88f9-4fdd-83b7-ab630955eb83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:45.188997 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-40da43ac-88f9-4fdd-83b7-ab630955eb83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:45.189785 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-40da43ac-88f9-4fdd-83b7-ab630955eb83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:45.190815 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-40da43ac-88f9-4fdd-83b7-ab630955eb83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:45.191640 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-40da43ac-88f9-4fdd-83b7-ab630955eb83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:45.192418 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-40da43ac-88f9-4fdd-83b7-ab630955eb83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:45.360858 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-40da43ac-88f9-4fdd-83b7-ab630955eb83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:45.370105 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-40da43ac-88f9-4fdd-83b7-ab630955eb83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:45.372026 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-40da43ac-88f9-4fdd-83b7-ab630955eb83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:45.373475 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-40da43ac-88f9-4fdd-83b7-ab630955eb83 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.206578 Aug 26 08:59:45.374069 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 491/981] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:45 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:46.129315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-78f2bd1c-6628-4cdf-899f-4c7feefb71c2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:46.130184 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-78f2bd1c-6628-4cdf-899f-4c7feefb71c2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:46.137072 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78f2bd1c-6628-4cdf-899f-4c7feefb71c2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:46.137564 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78f2bd1c-6628-4cdf-899f-4c7feefb71c2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:46.138007 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78f2bd1c-6628-4cdf-899f-4c7feefb71c2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:46.138847 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78f2bd1c-6628-4cdf-899f-4c7feefb71c2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:46.139340 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78f2bd1c-6628-4cdf-899f-4c7feefb71c2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:46.139752 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78f2bd1c-6628-4cdf-899f-4c7feefb71c2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:46.180286 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78f2bd1c-6628-4cdf-899f-4c7feefb71c2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:46.180766 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78f2bd1c-6628-4cdf-899f-4c7feefb71c2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:46.181217 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-78f2bd1c-6628-4cdf-899f-4c7feefb71c2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:46.181647 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-78f2bd1c-6628-4cdf-899f-4c7feefb71c2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'fault' on Instance uuid 0695da3e-654d-4b9d-be68-e195e539e831 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:46.235973 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-78f2bd1c-6628-4cdf-899f-4c7feefb71c2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:46.242521 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:46.252916 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-78f2bd1c-6628-4cdf-899f-4c7feefb71c2 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1331 microversion: 2.1 time: 0.128129 Aug 26 08:59:46.253529 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 491/982] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:46 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1331 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:46.400609 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6e4b9210-ef08-401f-b07e-747ec889e330 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:46.402473 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6e4b9210-ef08-401f-b07e-747ec889e330 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:46.410487 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e4b9210-ef08-401f-b07e-747ec889e330 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:46.411243 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e4b9210-ef08-401f-b07e-747ec889e330 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:46.412036 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e4b9210-ef08-401f-b07e-747ec889e330 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:46.413349 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e4b9210-ef08-401f-b07e-747ec889e330 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:46.414336 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e4b9210-ef08-401f-b07e-747ec889e330 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:46.415075 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e4b9210-ef08-401f-b07e-747ec889e330 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:46.643933 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6e4b9210-ef08-401f-b07e-747ec889e330 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:46.660016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6e4b9210-ef08-401f-b07e-747ec889e330 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:46.661559 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6e4b9210-ef08-401f-b07e-747ec889e330 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:46.662916 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6e4b9210-ef08-401f-b07e-747ec889e330 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.268732 Aug 26 08:59:46.675758 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 492/983] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:46 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:47.285157 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0e6c057b-150f-462e-aa42-3c36815932ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:47.286853 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0e6c057b-150f-462e-aa42-3c36815932ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:47.296702 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0e6c057b-150f-462e-aa42-3c36815932ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:47.297439 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0e6c057b-150f-462e-aa42-3c36815932ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:47.298001 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0e6c057b-150f-462e-aa42-3c36815932ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:47.299381 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0e6c057b-150f-462e-aa42-3c36815932ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:47.299945 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0e6c057b-150f-462e-aa42-3c36815932ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:47.300830 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0e6c057b-150f-462e-aa42-3c36815932ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:47.342594 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0e6c057b-150f-462e-aa42-3c36815932ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:47.343470 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0e6c057b-150f-462e-aa42-3c36815932ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:47.344095 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0e6c057b-150f-462e-aa42-3c36815932ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:47.345531 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-0e6c057b-150f-462e-aa42-3c36815932ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'fault' on Instance uuid 0695da3e-654d-4b9d-be68-e195e539e831 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:47.398169 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0e6c057b-150f-462e-aa42-3c36815932ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:47.406961 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0e6c057b-150f-462e-aa42-3c36815932ca tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1331 microversion: 2.1 time: 0.130684 Aug 26 08:59:47.407574 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 492/984] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:47 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:47.690050 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6c50eefb-e704-4aea-b174-c4c1394d00af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:47.691943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6c50eefb-e704-4aea-b174-c4c1394d00af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:47.699659 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c50eefb-e704-4aea-b174-c4c1394d00af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:47.701162 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c50eefb-e704-4aea-b174-c4c1394d00af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:47.702092 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c50eefb-e704-4aea-b174-c4c1394d00af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:47.703161 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c50eefb-e704-4aea-b174-c4c1394d00af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:47.703848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c50eefb-e704-4aea-b174-c4c1394d00af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:47.704778 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6c50eefb-e704-4aea-b174-c4c1394d00af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:48.232618 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6c50eefb-e704-4aea-b174-c4c1394d00af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:48.248323 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6c50eefb-e704-4aea-b174-c4c1394d00af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:48.249924 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6c50eefb-e704-4aea-b174-c4c1394d00af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:48.251516 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6c50eefb-e704-4aea-b174-c4c1394d00af tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.566479 Aug 26 08:59:48.252435 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 493/985] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:47 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:48.431480 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-40834136-fbec-4a44-bc72-91c393d31311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:48.433156 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-40834136-fbec-4a44-bc72-91c393d31311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:48.443915 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-40834136-fbec-4a44-bc72-91c393d31311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:48.444967 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-40834136-fbec-4a44-bc72-91c393d31311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:48.445649 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-40834136-fbec-4a44-bc72-91c393d31311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:48.446548 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-40834136-fbec-4a44-bc72-91c393d31311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:48.447133 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-40834136-fbec-4a44-bc72-91c393d31311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:48.447843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-40834136-fbec-4a44-bc72-91c393d31311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:48.487675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-40834136-fbec-4a44-bc72-91c393d31311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:48.488708 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-40834136-fbec-4a44-bc72-91c393d31311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:48.488708 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-40834136-fbec-4a44-bc72-91c393d31311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:48.489199 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-40834136-fbec-4a44-bc72-91c393d31311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'fault' on Instance uuid 0695da3e-654d-4b9d-be68-e195e539e831 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:48.541390 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-40834136-fbec-4a44-bc72-91c393d31311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:48.551863 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-40834136-fbec-4a44-bc72-91c393d31311 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1331 microversion: 2.1 time: 0.125908 Aug 26 08:59:48.552556 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 493/986] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:48 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1331 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:49.281629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b72f826e-fc62-4ff1-8e4d-cd44bade659c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:49.282590 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b72f826e-fc62-4ff1-8e4d-cd44bade659c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:49.295401 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b72f826e-fc62-4ff1-8e4d-cd44bade659c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:49.295401 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b72f826e-fc62-4ff1-8e4d-cd44bade659c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:49.295694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b72f826e-fc62-4ff1-8e4d-cd44bade659c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:49.296366 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b72f826e-fc62-4ff1-8e4d-cd44bade659c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:49.296811 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b72f826e-fc62-4ff1-8e4d-cd44bade659c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:49.297278 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b72f826e-fc62-4ff1-8e4d-cd44bade659c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:49.462564 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b72f826e-fc62-4ff1-8e4d-cd44bade659c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:49.471212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b72f826e-fc62-4ff1-8e4d-cd44bade659c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:49.472698 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b72f826e-fc62-4ff1-8e4d-cd44bade659c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:49.473896 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b72f826e-fc62-4ff1-8e4d-cd44bade659c tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.198437 Aug 26 08:59:49.474472 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 494/987] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:49 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:49.575854 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-69222236-8152-4db8-8e1c-b58ff45d6644 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:49.576550 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-69222236-8152-4db8-8e1c-b58ff45d6644 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:49.584146 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69222236-8152-4db8-8e1c-b58ff45d6644 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:49.584646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69222236-8152-4db8-8e1c-b58ff45d6644 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:49.585245 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69222236-8152-4db8-8e1c-b58ff45d6644 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:49.585961 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69222236-8152-4db8-8e1c-b58ff45d6644 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:49.586624 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69222236-8152-4db8-8e1c-b58ff45d6644 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:49.587101 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69222236-8152-4db8-8e1c-b58ff45d6644 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:49.626618 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69222236-8152-4db8-8e1c-b58ff45d6644 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:49.627517 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69222236-8152-4db8-8e1c-b58ff45d6644 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:49.627937 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-69222236-8152-4db8-8e1c-b58ff45d6644 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:49.628393 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-69222236-8152-4db8-8e1c-b58ff45d6644 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'fault' on Instance uuid 0695da3e-654d-4b9d-be68-e195e539e831 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:49.675628 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-69222236-8152-4db8-8e1c-b58ff45d6644 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:49.683843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-69222236-8152-4db8-8e1c-b58ff45d6644 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1331 microversion: 2.1 time: 0.112686 Aug 26 08:59:49.684461 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 494/988] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:49 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:50.497830 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e8562615-c09a-48aa-a9fd-685952b7ff6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:50.498471 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e8562615-c09a-48aa-a9fd-685952b7ff6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:50.507268 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e8562615-c09a-48aa-a9fd-685952b7ff6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:50.507766 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e8562615-c09a-48aa-a9fd-685952b7ff6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:50.508200 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e8562615-c09a-48aa-a9fd-685952b7ff6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:50.508904 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e8562615-c09a-48aa-a9fd-685952b7ff6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:50.509366 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e8562615-c09a-48aa-a9fd-685952b7ff6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:50.509791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-e8562615-c09a-48aa-a9fd-685952b7ff6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:50.673275 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e8562615-c09a-48aa-a9fd-685952b7ff6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:50.682403 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e8562615-c09a-48aa-a9fd-685952b7ff6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:50.684001 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e8562615-c09a-48aa-a9fd-685952b7ff6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:50.685184 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e8562615-c09a-48aa-a9fd-685952b7ff6f tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.191616 Aug 26 08:59:50.685930 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 495/989] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:50 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:50.709116 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f5a15fcd-34e8-449f-b49e-b478fde43f15 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:50.710041 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f5a15fcd-34e8-449f-b49e-b478fde43f15 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:50.716955 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5a15fcd-34e8-449f-b49e-b478fde43f15 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:50.717434 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5a15fcd-34e8-449f-b49e-b478fde43f15 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:50.717858 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5a15fcd-34e8-449f-b49e-b478fde43f15 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:50.718592 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5a15fcd-34e8-449f-b49e-b478fde43f15 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:50.719087 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5a15fcd-34e8-449f-b49e-b478fde43f15 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:50.719491 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5a15fcd-34e8-449f-b49e-b478fde43f15 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:50.798919 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5a15fcd-34e8-449f-b49e-b478fde43f15 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:50.801189 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5a15fcd-34e8-449f-b49e-b478fde43f15 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:50.801189 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f5a15fcd-34e8-449f-b49e-b478fde43f15 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:50.801189 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-f5a15fcd-34e8-449f-b49e-b478fde43f15 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'fault' on Instance uuid 0695da3e-654d-4b9d-be68-e195e539e831 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:50.856910 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f5a15fcd-34e8-449f-b49e-b478fde43f15 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:50.866158 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f5a15fcd-34e8-449f-b49e-b478fde43f15 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1331 microversion: 2.1 time: 0.162703 Aug 26 08:59:50.866763 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 495/990] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:50 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1331 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:51.711846 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3ebcbebf-6821-40c0-8845-7073095b3ef6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:51.712751 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3ebcbebf-6821-40c0-8845-7073095b3ef6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:51.723076 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ebcbebf-6821-40c0-8845-7073095b3ef6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:51.723835 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ebcbebf-6821-40c0-8845-7073095b3ef6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:51.724272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ebcbebf-6821-40c0-8845-7073095b3ef6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:51.725237 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ebcbebf-6821-40c0-8845-7073095b3ef6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:51.725766 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ebcbebf-6821-40c0-8845-7073095b3ef6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:51.726339 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3ebcbebf-6821-40c0-8845-7073095b3ef6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:51.888043 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-be3c8976-6d63-4b26-8e81-0f81fb058417 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:51.894046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-be3c8976-6d63-4b26-8e81-0f81fb058417 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:51.904659 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-be3c8976-6d63-4b26-8e81-0f81fb058417 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:51.905476 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-be3c8976-6d63-4b26-8e81-0f81fb058417 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:51.906223 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-be3c8976-6d63-4b26-8e81-0f81fb058417 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:51.908105 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-be3c8976-6d63-4b26-8e81-0f81fb058417 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:51.908425 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-be3c8976-6d63-4b26-8e81-0f81fb058417 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:51.908702 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-be3c8976-6d63-4b26-8e81-0f81fb058417 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:51.937023 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3ebcbebf-6821-40c0-8845-7073095b3ef6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:51.947795 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3ebcbebf-6821-40c0-8845-7073095b3ef6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:51.949289 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-3ebcbebf-6821-40c0-8845-7073095b3ef6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:51.950809 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-3ebcbebf-6821-40c0-8845-7073095b3ef6 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.244114 Aug 26 08:59:51.951472 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 496/991] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:51 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:51.964441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-be3c8976-6d63-4b26-8e81-0f81fb058417 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:51.965292 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-be3c8976-6d63-4b26-8e81-0f81fb058417 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:51.966088 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-be3c8976-6d63-4b26-8e81-0f81fb058417 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:51.966963 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-be3c8976-6d63-4b26-8e81-0f81fb058417 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'fault' on Instance uuid 0695da3e-654d-4b9d-be68-e195e539e831 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:52.048530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-be3c8976-6d63-4b26-8e81-0f81fb058417 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:52.061045 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-be3c8976-6d63-4b26-8e81-0f81fb058417 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 200 len: 1331 microversion: 2.1 time: 0.177823 Aug 26 08:59:52.075147 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 496/992] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:51 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 1331 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 08:59:52.297008 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-45b31f17-d458-4c9c-878a-370fef29edce tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:52.301864 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-45b31f17-d458-4c9c-878a-370fef29edce tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:52.314132 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-45b31f17-d458-4c9c-878a-370fef29edce tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:52.315317 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-45b31f17-d458-4c9c-878a-370fef29edce tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:52.316333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-45b31f17-d458-4c9c-878a-370fef29edce tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:52.318451 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-45b31f17-d458-4c9c-878a-370fef29edce tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:52.320384 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-45b31f17-d458-4c9c-878a-370fef29edce tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:52.321413 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-45b31f17-d458-4c9c-878a-370fef29edce tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:52.397230 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-45b31f17-d458-4c9c-878a-370fef29edce tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.110173 Aug 26 08:59:52.398138 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 497/993] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:52 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments => generated 371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:52.541921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1fbbc49b-fee5-4ceb-a00a-915bf79aa6f1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:52.542414 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1fbbc49b-fee5-4ceb-a00a-915bf79aa6f1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:52.549292 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1fbbc49b-fee5-4ceb-a00a-915bf79aa6f1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:52.549762 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1fbbc49b-fee5-4ceb-a00a-915bf79aa6f1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:52.550178 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1fbbc49b-fee5-4ceb-a00a-915bf79aa6f1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:52.550937 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1fbbc49b-fee5-4ceb-a00a-915bf79aa6f1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:52.551376 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1fbbc49b-fee5-4ceb-a00a-915bf79aa6f1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:52.551871 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1fbbc49b-fee5-4ceb-a00a-915bf79aa6f1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:52.583143 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1fbbc49b-fee5-4ceb-a00a-915bf79aa6f1 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments/9d3ee2db-0482-4d9a-9ae3-0dc019f68d64" status: 200 len: 194 microversion: 2.1 time: 0.045613 Aug 26 08:59:52.583776 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 497/994] 10.222.0.71 () {58 vars in 1413 bytes} [Fri Aug 26 08:59:52 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments/9d3ee2db-0482-4d9a-9ae3-0dc019f68d64 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:52.594704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a22a0012-be79-42f5-9b31-b586250a2fb0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:52.595293 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a22a0012-be79-42f5-9b31-b586250a2fb0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:52.601869 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a22a0012-be79-42f5-9b31-b586250a2fb0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:52.602350 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a22a0012-be79-42f5-9b31-b586250a2fb0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:52.602853 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a22a0012-be79-42f5-9b31-b586250a2fb0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:52.603557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a22a0012-be79-42f5-9b31-b586250a2fb0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:52.604005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a22a0012-be79-42f5-9b31-b586250a2fb0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:52.604481 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a22a0012-be79-42f5-9b31-b586250a2fb0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:52.705129 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-a22a0012-be79-42f5-9b31-b586250a2fb0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lazy-loading 'services' on Instance uuid e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:52.794234 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a22a0012-be79-42f5-9b31-b586250a2fb0 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments/9d3ee2db-0482-4d9a-9ae3-0dc019f68d64" status: 202 len: 0 microversion: 2.1 time: 0.203497 Aug 26 08:59:52.795959 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 498/995] 10.222.0.71 () {58 vars in 1416 bytes} [Fri Aug 26 08:59:52 2022] DELETE /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments/9d3ee2db-0482-4d9a-9ae3-0dc019f68d64 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:59:52.991307 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2315f3a4-3633-4e36-a800-a4dc00171049 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:52.991307 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2315f3a4-3633-4e36-a800-a4dc00171049 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:52.999715 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2315f3a4-3633-4e36-a800-a4dc00171049 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:53.000217 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2315f3a4-3633-4e36-a800-a4dc00171049 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:53.000694 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2315f3a4-3633-4e36-a800-a4dc00171049 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:53.001488 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2315f3a4-3633-4e36-a800-a4dc00171049 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:53.001946 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2315f3a4-3633-4e36-a800-a4dc00171049 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:53.002724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2315f3a4-3633-4e36-a800-a4dc00171049 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:53.084807 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-224e43ec-a268-48e4-a728-0c20100e30cc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:53.085541 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-224e43ec-a268-48e4-a728-0c20100e30cc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:53.092007 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-224e43ec-a268-48e4-a728-0c20100e30cc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:53.092581 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-224e43ec-a268-48e4-a728-0c20100e30cc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:53.093110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-224e43ec-a268-48e4-a728-0c20100e30cc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:53.093898 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-224e43ec-a268-48e4-a728-0c20100e30cc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:53.094425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-224e43ec-a268-48e4-a728-0c20100e30cc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:53.095043 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-224e43ec-a268-48e4-a728-0c20100e30cc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:53.109834 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-224e43ec-a268-48e4-a728-0c20100e30cc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] HTTP exception thrown: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-224e43ec-a268-48e4-a728-0c20100e30cc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Request method failure captured: Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 HTTP/1.1 Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIoEmQS0ltyE06Nj4PuDW7tRWlQx7ddVxbpmBorGEN4vH-Qi6t2BygustSi6IBEkokqI2I_SWwZYOmA6m8lhi8TWDRbttWpAHlEIqCkO0TFDD5IrIzdgnbzjwj6reGrNhrygHKk-ixwJbs_wRUzJRPtDT1VapHI831oEiCSS5Q537B4 Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 08:59:53.111658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 08:59:53.114452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f87dce6d7f01455fb8c3cfe128c20e72", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 08:59:53.114452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:59:53.114452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 08:59:53.114452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 08:59:53.114452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 08:59:53.114452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 08:59:53.114452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 08:59:53.114452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 406be06d6adf40bbb48d9baf12022988 Aug 26 08:59:53.114452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 08:59:53.114452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 08:59:53.114452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 08:59:53.114452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '0695da3e-654d-4b9d-be68-e195e539e831'} Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 08:59:53.115849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 08:59:53.117426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 08:59:53.118615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-224e43ec-a268-48e4-a728-0c20100e30cc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Returning 404 to user: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 08:59:53.118615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-224e43ec-a268-48e4-a728-0c20100e30cc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 404 len: 111 microversion: 2.1 time: 0.033975 Aug 26 08:59:53.118615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 499/996] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:53 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 08:59:53.122054 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b15cf38d-c618-418f-b751-16dbf30cdf6e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '.version_select at 0x7f1367e1b310>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:53.146321 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b15cf38d-c618-418f-b751-16dbf30cdf6e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-858458509" status: 202 len: 0 microversion: 2.1 time: 0.027782 Aug 26 08:59:53.147022 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 500/997] 10.222.0.71 () {58 vars in 1218 bytes} [Fri Aug 26 08:59:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-858458509 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:59:53.173223 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2315f3a4-3633-4e36-a800-a4dc00171049 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:53.182990 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2315f3a4-3633-4e36-a800-a4dc00171049 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:53.184390 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2315f3a4-3633-4e36-a800-a4dc00171049 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:53.185726 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2315f3a4-3633-4e36-a800-a4dc00171049 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.199369 Aug 26 08:59:53.186314 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 498/998] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:52 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:54.004042 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-47f7874a-a8f8-4e80-a196-86e9c31bfa76 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Action: 'create', calling method: .version_select at 0x7f1367ea60d0>, body: {"keypair": {"name": "tempest-keypair-1710083053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHi/9lImP/GUGX2036FLcQE2KWeVyVc3EsOYFCm3bqtSFZHTjFUT12mSvl3i7cE+O5wCNlWyO1J0yIjoiigZHsw+PnlU5LGD8G/0Ikr/sZtt54fdGFzUwE1+osKW6CkBg=="}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:54.024916 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-47f7874a-a8f8-4e80-a196-86e9c31bfa76 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'key_pairs'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:59:54.029238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-47f7874a-a8f8-4e80-a196-86e9c31bfa76 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for user 406be06d6adf40bbb48d9baf12022988 and project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'key_pairs'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:59:54.057914 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-47f7874a-a8f8-4e80-a196-86e9c31bfa76 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056000 Aug 26 08:59:54.057914 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 501/999] 10.222.0.71 () {60 vars in 1159 bytes} [Fri Aug 26 08:59:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 08:59:54.215714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d9781524-185f-4ed5-a07b-f3843d8c0fa3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:54.217050 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d9781524-185f-4ed5-a07b-f3843d8c0fa3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:54.228863 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d9781524-185f-4ed5-a07b-f3843d8c0fa3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:54.229361 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d9781524-185f-4ed5-a07b-f3843d8c0fa3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:54.229811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d9781524-185f-4ed5-a07b-f3843d8c0fa3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:54.230547 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d9781524-185f-4ed5-a07b-f3843d8c0fa3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:54.231010 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d9781524-185f-4ed5-a07b-f3843d8c0fa3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:54.231580 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d9781524-185f-4ed5-a07b-f3843d8c0fa3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:54.427910 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d9781524-185f-4ed5-a07b-f3843d8c0fa3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:54.441384 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d9781524-185f-4ed5-a07b-f3843d8c0fa3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:54.443216 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d9781524-185f-4ed5-a07b-f3843d8c0fa3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:54.444763 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d9781524-185f-4ed5-a07b-f3843d8c0fa3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.233706 Aug 26 08:59:54.445527 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 499/1000] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:54 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:54.862023 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-410be1c5-89b2-4fe8-b665-41e65e1a4f22 req-41adc303-eee9-4beb-aabf-648520d3b589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbfe1e03-de30-4198-9a4d-a96708dbb98b", "name": "network-vif-plugged", "status": "completed", "tag": "57b16be7-70f7-4545-b557-e106d767a915"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:54.885083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-410be1c5-89b2-4fe8-b665-41e65e1a4f22 req-41adc303-eee9-4beb-aabf-648520d3b589 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:54.885083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-410be1c5-89b2-4fe8-b665-41e65e1a4f22 req-41adc303-eee9-4beb-aabf-648520d3b589 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:54.885083 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-410be1c5-89b2-4fe8-b665-41e65e1a4f22 req-41adc303-eee9-4beb-aabf-648520d3b589 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:54.900826 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-410be1c5-89b2-4fe8-b665-41e65e1a4f22 req-41adc303-eee9-4beb-aabf-648520d3b589 service nova] Creating event network-vif-plugged:57b16be7-70f7-4545-b557-e106d767a915 for instance cbfe1e03-de30-4198-9a4d-a96708dbb98b on hv-cinder-85236 Aug 26 08:59:54.910288 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-410be1c5-89b2-4fe8-b665-41e65e1a4f22 req-41adc303-eee9-4beb-aabf-648520d3b589 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053612 Aug 26 08:59:54.911058 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 502/1001] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 08:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:55.089263 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8189488f-b23e-42f5-b500-9a6fc191a275 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:55.089858 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8189488f-b23e-42f5-b500-9a6fc191a275 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:55.097904 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8189488f-b23e-42f5-b500-9a6fc191a275 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:55.102097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8189488f-b23e-42f5-b500-9a6fc191a275 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:55.102764 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8189488f-b23e-42f5-b500-9a6fc191a275 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:55.104851 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8189488f-b23e-42f5-b500-9a6fc191a275 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:55.104851 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8189488f-b23e-42f5-b500-9a6fc191a275 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:55.104851 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8189488f-b23e-42f5-b500-9a6fc191a275 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:55.150440 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8189488f-b23e-42f5-b500-9a6fc191a275 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments/cccadab1-0206-4e85-aaa8-2741631efd09" status: 200 len: 194 microversion: 2.1 time: 0.065181 Aug 26 08:59:55.151778 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 500/1002] 10.222.0.71 () {58 vars in 1413 bytes} [Fri Aug 26 08:59:55 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments/cccadab1-0206-4e85-aaa8-2741631efd09 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 08:59:55.164546 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-bdbb1f27-391a-4015-8fc8-4d107a871374 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:55.165272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-bdbb1f27-391a-4015-8fc8-4d107a871374 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:55.175685 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bdbb1f27-391a-4015-8fc8-4d107a871374 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:55.177411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bdbb1f27-391a-4015-8fc8-4d107a871374 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:55.177845 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bdbb1f27-391a-4015-8fc8-4d107a871374 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:55.179392 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bdbb1f27-391a-4015-8fc8-4d107a871374 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:55.179790 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bdbb1f27-391a-4015-8fc8-4d107a871374 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:55.180439 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-bdbb1f27-391a-4015-8fc8-4d107a871374 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:55.364413 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-bdbb1f27-391a-4015-8fc8-4d107a871374 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lazy-loading 'services' on Instance uuid e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 08:59:55.473900 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-55e2d4a9-9f75-4443-9188-65418fe3aac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:55.474791 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-55e2d4a9-9f75-4443-9188-65418fe3aac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:55.485988 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-55e2d4a9-9f75-4443-9188-65418fe3aac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:55.486752 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-55e2d4a9-9f75-4443-9188-65418fe3aac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:55.487567 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-55e2d4a9-9f75-4443-9188-65418fe3aac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:55.488831 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-55e2d4a9-9f75-4443-9188-65418fe3aac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:55.489511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-55e2d4a9-9f75-4443-9188-65418fe3aac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:55.490567 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-55e2d4a9-9f75-4443-9188-65418fe3aac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:55.515345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-bdbb1f27-391a-4015-8fc8-4d107a871374 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments/cccadab1-0206-4e85-aaa8-2741631efd09" status: 202 len: 0 microversion: 2.1 time: 0.355835 Aug 26 08:59:55.516468 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 503/1003] 10.222.0.71 () {58 vars in 1416 bytes} [Fri Aug 26 08:59:55 2022] DELETE /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments/cccadab1-0206-4e85-aaa8-2741631efd09 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 08:59:55.768063 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-55e2d4a9-9f75-4443-9188-65418fe3aac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:55.780199 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-55e2d4a9-9f75-4443-9188-65418fe3aac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:55.781768 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-55e2d4a9-9f75-4443-9188-65418fe3aac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:55.783103 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-55e2d4a9-9f75-4443-9188-65418fe3aac3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.316540 Aug 26 08:59:55.783664 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 501/1004] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:55 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:55.970301 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-436196525", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e1c5bc8-bb18-4879-912d-f9e237efa42e"}], "security_groups": [{"name": "tempest-securitygroup--1355685601"}], "key_name": "tempest-keypair-1710083053", "user_data": "}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 08:59:56.095109 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.network.neutron [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] validate_networks() for [('4e1c5bc8-bb18-4879-912d-f9e237efa42e', None, None, None, None, None)] {{(pid=132217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 08:59:56.674786 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Flavor limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 08:59:56.675446 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Image limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 08:59:56.676355 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Flavor pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 08:59:56.676721 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Image pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 08:59:56.677279 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 08:59:56.689472 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:56.690075 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:56.690510 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:56.691750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:56.692286 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:56.692777 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:56.719950 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 08:59:56.724699 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Getting quotas for user 406be06d6adf40bbb48d9baf12022988 and project f87dce6d7f01455fb8c3cfe128c20e72. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 08:59:56.751661 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Going to run 1 instances... {{(pid=132217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 08:59:56.757027 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 08:59:56.817093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3b085dd4-a688-43e1-8327-0811a2181afb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:56.818801 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3b085dd4-a688-43e1-8327-0811a2181afb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:56.827394 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3b085dd4-a688-43e1-8327-0811a2181afb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:56.827995 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3b085dd4-a688-43e1-8327-0811a2181afb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:56.828752 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3b085dd4-a688-43e1-8327-0811a2181afb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:56.829680 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3b085dd4-a688-43e1-8327-0811a2181afb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:56.830482 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3b085dd4-a688-43e1-8327-0811a2181afb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:56.832101 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3b085dd4-a688-43e1-8327-0811a2181afb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:56.888730 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8ff0b12b-726c-42a2-b65f-cf670da747da tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.923132 Aug 26 08:59:56.893549 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 504/1005] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 08:59:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 08:59:56.903439 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-e259dedc-0cad-4e41-ac34-fea5559c314d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:56.904269 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-e259dedc-0cad-4e41-ac34-fea5559c314d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:57.000120 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-e259dedc-0cad-4e41-ac34-fea5559c314d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:57.010529 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-e259dedc-0cad-4e41-ac34-fea5559c314d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1241 microversion: 2.1 time: 0.111919 Aug 26 08:59:57.022943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 505/1006] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:56 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:57.057204 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3b085dd4-a688-43e1-8327-0811a2181afb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:57.070748 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3b085dd4-a688-43e1-8327-0811a2181afb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:57.073470 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3b085dd4-a688-43e1-8327-0811a2181afb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:57.075647 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3b085dd4-a688-43e1-8327-0811a2181afb tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.269302 Aug 26 08:59:57.077052 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 502/1007] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:56 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:57.862271 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fb0e6c96-dae4-441f-af57-a511e1c28bb9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:57.865590 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-fb0e6c96-dae4-441f-af57-a511e1c28bb9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:57.873613 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb0e6c96-dae4-441f-af57-a511e1c28bb9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:57.874114 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb0e6c96-dae4-441f-af57-a511e1c28bb9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:57.874544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb0e6c96-dae4-441f-af57-a511e1c28bb9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:57.875764 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb0e6c96-dae4-441f-af57-a511e1c28bb9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:57.876272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb0e6c96-dae4-441f-af57-a511e1c28bb9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:57.876725 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-fb0e6c96-dae4-441f-af57-a511e1c28bb9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:57.925422 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fb0e6c96-dae4-441f-af57-a511e1c28bb9 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070996 Aug 26 08:59:57.926495 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 506/1008] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:57 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 08:59:58.044665 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f991dbf7-22d9-4b62-9519-943dbc9beef6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:58.045598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f991dbf7-22d9-4b62-9519-943dbc9beef6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:58.055751 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f991dbf7-22d9-4b62-9519-943dbc9beef6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:58.056609 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f991dbf7-22d9-4b62-9519-943dbc9beef6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:58.057972 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f991dbf7-22d9-4b62-9519-943dbc9beef6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:58.059034 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f991dbf7-22d9-4b62-9519-943dbc9beef6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:58.060253 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f991dbf7-22d9-4b62-9519-943dbc9beef6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:58.060747 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f991dbf7-22d9-4b62-9519-943dbc9beef6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:58.096251 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f84f7c60-d2d2-46f3-acbd-34b956257096 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:58.098623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f84f7c60-d2d2-46f3-acbd-34b956257096 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:58.105876 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f84f7c60-d2d2-46f3-acbd-34b956257096 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:58.106376 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f84f7c60-d2d2-46f3-acbd-34b956257096 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:58.106814 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f84f7c60-d2d2-46f3-acbd-34b956257096 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:58.107589 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f84f7c60-d2d2-46f3-acbd-34b956257096 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:58.108040 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f84f7c60-d2d2-46f3-acbd-34b956257096 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:58.108467 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f84f7c60-d2d2-46f3-acbd-34b956257096 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:58.116679 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:58.159649 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f991dbf7-22d9-4b62-9519-943dbc9beef6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:58.161321 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f84f7c60-d2d2-46f3-acbd-34b956257096 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069358 Aug 26 08:59:58.162699 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 507/1009] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 08:59:58 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 08:59:58.173436 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-533f9bf8-078b-4cba-9ce0-01378b00c5f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:58.174794 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-533f9bf8-078b-4cba-9ce0-01378b00c5f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:58.177173 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f991dbf7-22d9-4b62-9519-943dbc9beef6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1293 microversion: 2.1 time: 0.140563 Aug 26 08:59:58.190456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-533f9bf8-078b-4cba-9ce0-01378b00c5f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:58.191308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-533f9bf8-078b-4cba-9ce0-01378b00c5f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:58.191957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-533f9bf8-078b-4cba-9ce0-01378b00c5f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:58.192075 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 503/1010] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:58 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1293 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:58.193079 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-533f9bf8-078b-4cba-9ce0-01378b00c5f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:58.193688 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-533f9bf8-078b-4cba-9ce0-01378b00c5f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:58.194118 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-533f9bf8-078b-4cba-9ce0-01378b00c5f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:58.254565 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9b6794e5-7f42-442b-988a-399a6632cdb2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:58.255105 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9b6794e5-7f42-442b-988a-399a6632cdb2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:58.262228 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6794e5-7f42-442b-988a-399a6632cdb2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:58.263008 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6794e5-7f42-442b-988a-399a6632cdb2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:58.263599 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6794e5-7f42-442b-988a-399a6632cdb2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:58.264539 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6794e5-7f42-442b-988a-399a6632cdb2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:58.265210 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6794e5-7f42-442b-988a-399a6632cdb2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:58.265811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9b6794e5-7f42-442b-988a-399a6632cdb2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:58.324539 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9b6794e5-7f42-442b-988a-399a6632cdb2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 08:59:58.394675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-533f9bf8-078b-4cba-9ce0-01378b00c5f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:58.406001 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-533f9bf8-078b-4cba-9ce0-01378b00c5f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:58.408333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-533f9bf8-078b-4cba-9ce0-01378b00c5f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:58.409886 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-533f9bf8-078b-4cba-9ce0-01378b00c5f7 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1729 microversion: 2.20 time: 0.245673 Aug 26 08:59:58.410676 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 508/1011] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:58 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1729 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:58.464617 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9b6794e5-7f42-442b-988a-399a6632cdb2 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 204 len: 0 microversion: 2.1 time: 0.214005 Aug 26 08:59:58.467222 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 504/1012] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 08:59:58 2022] DELETE /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 08:59:58.479027 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-5b74fb31-15b8-4c62-bc38-269751eab6d7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:58.480343 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-5b74fb31-15b8-4c62-bc38-269751eab6d7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:58.492303 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5b74fb31-15b8-4c62-bc38-269751eab6d7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:58.493846 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5b74fb31-15b8-4c62-bc38-269751eab6d7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:58.495069 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5b74fb31-15b8-4c62-bc38-269751eab6d7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:58.496779 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5b74fb31-15b8-4c62-bc38-269751eab6d7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:58.498655 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5b74fb31-15b8-4c62-bc38-269751eab6d7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:58.499629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-5b74fb31-15b8-4c62-bc38-269751eab6d7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:58.717253 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-5b74fb31-15b8-4c62-bc38-269751eab6d7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:58.726164 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-5b74fb31-15b8-4c62-bc38-269751eab6d7 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1674 microversion: 2.1 time: 0.253987 Aug 26 08:59:58.726792 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 509/1013] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:58 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1674 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:59.202855 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-edee0131-c0ea-4af7-bad8-c73a7848f867 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:59.203747 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-edee0131-c0ea-4af7-bad8-c73a7848f867 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:59.206940 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:59.218245 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-edee0131-c0ea-4af7-bad8-c73a7848f867 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:59.219096 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-edee0131-c0ea-4af7-bad8-c73a7848f867 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:59.219836 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-edee0131-c0ea-4af7-bad8-c73a7848f867 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:59.221212 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-edee0131-c0ea-4af7-bad8-c73a7848f867 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:59.222068 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-edee0131-c0ea-4af7-bad8-c73a7848f867 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:59.222810 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-edee0131-c0ea-4af7-bad8-c73a7848f867 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:59.232816 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:59:59.358087 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-edee0131-c0ea-4af7-bad8-c73a7848f867 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:59.371938 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-edee0131-c0ea-4af7-bad8-c73a7848f867 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1301 microversion: 2.1 time: 0.174148 Aug 26 08:59:59.373188 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 505/1014] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:59 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1301 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 08:59:59.450492 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-b3ab80ce-371d-4c4f-8f8f-31b3e78c6a14 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:59.451696 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-b3ab80ce-371d-4c4f-8f8f-31b3e78c6a14 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:59.463723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b3ab80ce-371d-4c4f-8f8f-31b3e78c6a14 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:59.464607 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b3ab80ce-371d-4c4f-8f8f-31b3e78c6a14 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:59.465388 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b3ab80ce-371d-4c4f-8f8f-31b3e78c6a14 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:59.466692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b3ab80ce-371d-4c4f-8f8f-31b3e78c6a14 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:59.467553 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b3ab80ce-371d-4c4f-8f8f-31b3e78c6a14 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:59.468332 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-b3ab80ce-371d-4c4f-8f8f-31b3e78c6a14 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:59.730747 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b3ab80ce-371d-4c4f-8f8f-31b3e78c6a14 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:59.742442 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b3ab80ce-371d-4c4f-8f8f-31b3e78c6a14 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:59.743980 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-b3ab80ce-371d-4c4f-8f8f-31b3e78c6a14 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 08:59:59.745502 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-b3ab80ce-371d-4c4f-8f8f-31b3e78c6a14 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1716 microversion: 2.20 time: 0.304222 Aug 26 08:59:59.746858 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 510/1015] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 08:59:59 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1716 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 08:59:59.751829 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0fd4a544-66ca-4256-b372-9043f5058432 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 08:59:59.753185 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0fd4a544-66ca-4256-b372-9043f5058432 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 08:59:59.767811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0fd4a544-66ca-4256-b372-9043f5058432 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:59.768415 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0fd4a544-66ca-4256-b372-9043f5058432 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:59.769028 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0fd4a544-66ca-4256-b372-9043f5058432 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 08:59:59.770096 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0fd4a544-66ca-4256-b372-9043f5058432 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 08:59:59.771081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0fd4a544-66ca-4256-b372-9043f5058432 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 08:59:59.771722 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0fd4a544-66ca-4256-b372-9043f5058432 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:00.074687 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0fd4a544-66ca-4256-b372-9043f5058432 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:00.085293 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0fd4a544-66ca-4256-b372-9043f5058432 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1674 microversion: 2.1 time: 0.339819 Aug 26 09:00:00.086285 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 506/1016] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 08:59:59 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1674 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 09:00:00.403904 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-46065296-e9e1-4e3c-95f3-a2d323d06ca6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:00.404771 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-46065296-e9e1-4e3c-95f3-a2d323d06ca6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:00.407021 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:00.415071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-46065296-e9e1-4e3c-95f3-a2d323d06ca6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:00.415984 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-46065296-e9e1-4e3c-95f3-a2d323d06ca6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:00.417932 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-46065296-e9e1-4e3c-95f3-a2d323d06ca6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:00.419394 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-46065296-e9e1-4e3c-95f3-a2d323d06ca6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:00.420072 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-46065296-e9e1-4e3c-95f3-a2d323d06ca6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:00.420834 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-46065296-e9e1-4e3c-95f3-a2d323d06ca6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:00.551324 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-46065296-e9e1-4e3c-95f3-a2d323d06ca6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:00.573088 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-46065296-e9e1-4e3c-95f3-a2d323d06ca6 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1311 microversion: 2.1 time: 0.173797 Aug 26 09:00:00.574833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 511/1017] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:00 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1311 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:01.117866 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c551337b-2126-4f0a-88fa-274ec3b63fa4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:01.118795 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c551337b-2126-4f0a-88fa-274ec3b63fa4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:01.131949 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c551337b-2126-4f0a-88fa-274ec3b63fa4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:01.132967 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c551337b-2126-4f0a-88fa-274ec3b63fa4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:01.133907 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c551337b-2126-4f0a-88fa-274ec3b63fa4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:01.135507 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c551337b-2126-4f0a-88fa-274ec3b63fa4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:01.136694 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c551337b-2126-4f0a-88fa-274ec3b63fa4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:01.137445 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c551337b-2126-4f0a-88fa-274ec3b63fa4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:01.551838 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c551337b-2126-4f0a-88fa-274ec3b63fa4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:01.574573 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c551337b-2126-4f0a-88fa-274ec3b63fa4 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1674 microversion: 2.1 time: 0.463713 Aug 26 09:00:01.576542 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 507/1018] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:01 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1674 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 09:00:01.613740 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-accd7fee-fd4b-4277-a6d9-919e7ac4e15d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:01.615479 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-accd7fee-fd4b-4277-a6d9-919e7ac4e15d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:01.637417 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-accd7fee-fd4b-4277-a6d9-919e7ac4e15d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:01.641123 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-accd7fee-fd4b-4277-a6d9-919e7ac4e15d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:01.645590 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-accd7fee-fd4b-4277-a6d9-919e7ac4e15d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:01.649613 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-accd7fee-fd4b-4277-a6d9-919e7ac4e15d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:01.650457 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-accd7fee-fd4b-4277-a6d9-919e7ac4e15d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:01.651122 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-accd7fee-fd4b-4277-a6d9-919e7ac4e15d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:02.064032 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-accd7fee-fd4b-4277-a6d9-919e7ac4e15d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:02.072676 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-accd7fee-fd4b-4277-a6d9-919e7ac4e15d tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1367 microversion: 2.1 time: 0.467646 Aug 26 09:00:02.073324 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 512/1019] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:01 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1367 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:02.116527 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-a45dfa93-f23c-4c24-b7ed-52f510217638 req-9625caf9-0799-41da-9c13-c2edd4c15d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6", "name": "network-vif-deleted", "tag": "04af963c-42ee-4251-8552-a695dc2db4de"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:00:02.140647 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-a45dfa93-f23c-4c24-b7ed-52f510217638 req-9625caf9-0799-41da-9c13-c2edd4c15d45 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:02.141459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-a45dfa93-f23c-4c24-b7ed-52f510217638 req-9625caf9-0799-41da-9c13-c2edd4c15d45 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:02.142202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-a45dfa93-f23c-4c24-b7ed-52f510217638 req-9625caf9-0799-41da-9c13-c2edd4c15d45 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:02.158932 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-a45dfa93-f23c-4c24-b7ed-52f510217638 req-9625caf9-0799-41da-9c13-c2edd4c15d45 service nova] Creating event network-vif-deleted:04af963c-42ee-4251-8552-a695dc2db4de for instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 on hv-cinder-85236 Aug 26 09:00:02.166010 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-a45dfa93-f23c-4c24-b7ed-52f510217638 req-9625caf9-0799-41da-9c13-c2edd4c15d45 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052817 Aug 26 09:00:02.167727 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 508/1020] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:00:02.615785 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-93089214-0a5c-44e3-aa18-a7e0f7c7c046 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:02.622725 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-93089214-0a5c-44e3-aa18-a7e0f7c7c046 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:02.642645 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-93089214-0a5c-44e3-aa18-a7e0f7c7c046 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:02.643415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-93089214-0a5c-44e3-aa18-a7e0f7c7c046 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:02.644216 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-93089214-0a5c-44e3-aa18-a7e0f7c7c046 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:02.645182 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-93089214-0a5c-44e3-aa18-a7e0f7c7c046 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:02.645797 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-93089214-0a5c-44e3-aa18-a7e0f7c7c046 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:02.647206 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-93089214-0a5c-44e3-aa18-a7e0f7c7c046 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:02.693448 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-93089214-0a5c-44e3-aa18-a7e0f7c7c046 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:02.693949 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-93089214-0a5c-44e3-aa18-a7e0f7c7c046 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:02.694422 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-93089214-0a5c-44e3-aa18-a7e0f7c7c046 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:02.695367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-93089214-0a5c-44e3-aa18-a7e0f7c7c046 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lazy-loading 'fault' on Instance uuid e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 09:00:02.700476 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-99315b92-578a-4161-bacb-4960dbc81e12 req-3bfdd1bf-1829-431d-b59f-e5150a87f32b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da2a1535-5e7f-4273-92e8-000a88c5f734", "tag": "c41998fb-0115-456d-88ef-ace4792ba96c"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:00:02.718394 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-99315b92-578a-4161-bacb-4960dbc81e12 req-3bfdd1bf-1829-431d-b59f-e5150a87f32b service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:02.719097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-99315b92-578a-4161-bacb-4960dbc81e12 req-3bfdd1bf-1829-431d-b59f-e5150a87f32b service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:02.719696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-99315b92-578a-4161-bacb-4960dbc81e12 req-3bfdd1bf-1829-431d-b59f-e5150a87f32b service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:02.745879 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-99315b92-578a-4161-bacb-4960dbc81e12 req-3bfdd1bf-1829-431d-b59f-e5150a87f32b service nova] Creating event network-changed:c41998fb-0115-456d-88ef-ace4792ba96c for instance da2a1535-5e7f-4273-92e8-000a88c5f734 on hv-cinder-85236 Aug 26 09:00:02.755614 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-99315b92-578a-4161-bacb-4960dbc81e12 req-3bfdd1bf-1829-431d-b59f-e5150a87f32b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060560 Aug 26 09:00:02.756580 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 509/1021] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:00:02.811048 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-93089214-0a5c-44e3-aa18-a7e0f7c7c046 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6f722499abc409a8a345bcb70114eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aa61636dd846f0a95be974b6b99d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:02.831131 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-93089214-0a5c-44e3-aa18-a7e0f7c7c046 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 200 len: 1327 microversion: 2.1 time: 0.231200 Aug 26 09:00:02.836086 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 513/1022] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:02 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 1327 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:03.103186 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f2abafbb-c7c7-4d3f-83c8-9925ee82d6dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:03.104949 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f2abafbb-c7c7-4d3f-83c8-9925ee82d6dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:03.117622 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f2abafbb-c7c7-4d3f-83c8-9925ee82d6dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:03.119083 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f2abafbb-c7c7-4d3f-83c8-9925ee82d6dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:03.119995 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f2abafbb-c7c7-4d3f-83c8-9925ee82d6dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:03.121415 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f2abafbb-c7c7-4d3f-83c8-9925ee82d6dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:03.122411 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f2abafbb-c7c7-4d3f-83c8-9925ee82d6dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:03.124598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f2abafbb-c7c7-4d3f-83c8-9925ee82d6dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:03.339529 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f2abafbb-c7c7-4d3f-83c8-9925ee82d6dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:03.362086 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f2abafbb-c7c7-4d3f-83c8-9925ee82d6dd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1367 microversion: 2.1 time: 0.269500 Aug 26 09:00:03.363693 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 510/1023] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:03 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:03.872003 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a69eebf0-f690-433a-bcd9-e52905078586 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:03.873186 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a69eebf0-f690-433a-bcd9-e52905078586 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:03.881406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a69eebf0-f690-433a-bcd9-e52905078586 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:03.881973 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a69eebf0-f690-433a-bcd9-e52905078586 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:03.882406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a69eebf0-f690-433a-bcd9-e52905078586 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:03.883335 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a69eebf0-f690-433a-bcd9-e52905078586 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:03.883818 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a69eebf0-f690-433a-bcd9-e52905078586 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:03.884238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a69eebf0-f690-433a-bcd9-e52905078586 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:03.903501 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-a69eebf0-f690-433a-bcd9-e52905078586 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] HTTP exception thrown: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a69eebf0-f690-433a-bcd9-e52905078586 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Request method failure captured: Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 HTTP/1.1 Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCImguVpKK9Zk12eHtdVnDAzA6zfNo8OXZ-0mqTIIC0_O27LWymZVUab31e13DoTMkNQDVat7VUAxDgq2dwu1DluYKlsMwAgD9IR75Z8cYk0g3ORN88-GU3_fROH_xMCR-6I2VABTKwzG5k3JT0G68Wv1gBHTdY5CH15K2YL343ThESc Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 88aa61636dd846f0a95be974b6b99d05 Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:00:03.905340 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:00:03.907555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_88aa61636dd846f0a95be974b6b99d05", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:00:03.907555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:03.907555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 88aa61636dd846f0a95be974b6b99d05 Aug 26 09:00:03.907555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:03.907555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeTestJSON-39276367-project Aug 26 09:00:03.907555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:00:03.907555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:00:03.907555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: b6f722499abc409a8a345bcb70114eaf Aug 26 09:00:03.907555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeTestJSON-39276367-project Aug 26 09:00:03.907555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:00:03.907555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:03.907555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': 'e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6'} Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:00:03.908437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:03.909891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:03.911243 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a69eebf0-f690-433a-bcd9-e52905078586 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Returning 404 to user: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:00:03.911243 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a69eebf0-f690-433a-bcd9-e52905078586 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 404 len: 111 microversion: 2.1 time: 0.042187 Aug 26 09:00:03.911243 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 514/1024] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:03 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:00:03.915896 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a88866ff-c657-45d8-95f0-2645e3b24f1d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '.version_select at 0x7f136c186ca0>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:03.941377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a88866ff-c657-45d8-95f0-2645e3b24f1d tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-535697418" status: 202 len: 0 microversion: 2.1 time: 0.029239 Aug 26 09:00:03.941984 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 511/1025] 10.222.0.71 () {58 vars in 1218 bytes} [Fri Aug 26 09:00:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-535697418 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 09:00:04.396171 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-175ec64f-6ad2-4b95-bfd0-2385d0491fe8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:04.397638 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-175ec64f-6ad2-4b95-bfd0-2385d0491fe8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:04.409663 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-175ec64f-6ad2-4b95-bfd0-2385d0491fe8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:04.410652 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-175ec64f-6ad2-4b95-bfd0-2385d0491fe8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:04.411286 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-175ec64f-6ad2-4b95-bfd0-2385d0491fe8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:04.412664 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-175ec64f-6ad2-4b95-bfd0-2385d0491fe8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:04.413835 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-175ec64f-6ad2-4b95-bfd0-2385d0491fe8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:04.414982 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-175ec64f-6ad2-4b95-bfd0-2385d0491fe8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:04.671834 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-175ec64f-6ad2-4b95-bfd0-2385d0491fe8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:04.687897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-175ec64f-6ad2-4b95-bfd0-2385d0491fe8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1367 microversion: 2.1 time: 0.295357 Aug 26 09:00:04.689212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 515/1026] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:04 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:05.717296 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ca3c299d-a3cd-4ea7-a169-3fe849e83f65 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:05.718194 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ca3c299d-a3cd-4ea7-a169-3fe849e83f65 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:05.724821 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca3c299d-a3cd-4ea7-a169-3fe849e83f65 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:05.725312 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca3c299d-a3cd-4ea7-a169-3fe849e83f65 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:05.725972 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca3c299d-a3cd-4ea7-a169-3fe849e83f65 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:05.726692 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca3c299d-a3cd-4ea7-a169-3fe849e83f65 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:05.727240 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca3c299d-a3cd-4ea7-a169-3fe849e83f65 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:05.727662 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ca3c299d-a3cd-4ea7-a169-3fe849e83f65 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:05.918712 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ca3c299d-a3cd-4ea7-a169-3fe849e83f65 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:05.930568 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ca3c299d-a3cd-4ea7-a169-3fe849e83f65 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1367 microversion: 2.1 time: 0.219963 Aug 26 09:00:05.931413 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 512/1027] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:05 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:06.957865 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-694cbcb3-431a-4f5c-b9bc-87bb53e81ea9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:06.959036 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-694cbcb3-431a-4f5c-b9bc-87bb53e81ea9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:06.963170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:06.972916 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-694cbcb3-431a-4f5c-b9bc-87bb53e81ea9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:06.974142 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-694cbcb3-431a-4f5c-b9bc-87bb53e81ea9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:06.974914 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-694cbcb3-431a-4f5c-b9bc-87bb53e81ea9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:06.976164 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-694cbcb3-431a-4f5c-b9bc-87bb53e81ea9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:06.976967 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-694cbcb3-431a-4f5c-b9bc-87bb53e81ea9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:06.977719 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-694cbcb3-431a-4f5c-b9bc-87bb53e81ea9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:07.014788 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=12 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:07.115711 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3c8f968e-f8f9-4e7f-b787-99d7283e0271 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:07.116280 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3c8f968e-f8f9-4e7f-b787-99d7283e0271 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:07.124368 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3c8f968e-f8f9-4e7f-b787-99d7283e0271 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:07.124867 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3c8f968e-f8f9-4e7f-b787-99d7283e0271 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:07.125302 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3c8f968e-f8f9-4e7f-b787-99d7283e0271 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:07.126012 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3c8f968e-f8f9-4e7f-b787-99d7283e0271 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:07.126524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3c8f968e-f8f9-4e7f-b787-99d7283e0271 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:07.126968 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3c8f968e-f8f9-4e7f-b787-99d7283e0271 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:07.145570 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-3c8f968e-f8f9-4e7f-b787-99d7283e0271 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] HTTP exception thrown: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3c8f968e-f8f9-4e7f-b787-99d7283e0271 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Request method failure captured: Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: DELETE /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 HTTP/1.1 Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCImguVpKK9Zk12eHtdVnDAzA6zfNo8OXZ-0mqTIIC0_O27LWymZVUab31e13DoTMkNQDVat7VUAxDgq2dwu1DluYKlsMwAgD9IR75Z8cYk0g3ORN88-GU3_fROH_xMCR-6I2VABTKwzG5k3JT0G68Wv1gBHTdY5CH15K2YL343ThESc Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 88aa61636dd846f0a95be974b6b99d05 Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 09:00:07.147355 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 09:00:07.149140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_88aa61636dd846f0a95be974b6b99d05", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:00:07.149140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:07.149140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 88aa61636dd846f0a95be974b6b99d05 Aug 26 09:00:07.149140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:07.149140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-AttachVolumeTestJSON-39276367-project Aug 26 09:00:07.149140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 09:00:07.149140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 09:00:07.149140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: b6f722499abc409a8a345bcb70114eaf Aug 26 09:00:07.149140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-AttachVolumeTestJSON-39276367-project Aug 26 09:00:07.149140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 09:00:07.149140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:07.149140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': 'e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6'} Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:00:07.150107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:07.151741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:07.153367 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3c8f968e-f8f9-4e7f-b787-99d7283e0271 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Returning 404 to user: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:00:07.153367 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3c8f968e-f8f9-4e7f-b787-99d7283e0271 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 404 len: 111 microversion: 2.1 time: 0.037308 Aug 26 09:00:07.153367 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 513/1028] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 09:00:07 2022] DELETE /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 09:00:07.158153 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a9a5e14c-cec1-4ca6-a45a-3bca7cece17b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:07.158784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a9a5e14c-cec1-4ca6-a45a-3bca7cece17b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:07.165459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a9a5e14c-cec1-4ca6-a45a-3bca7cece17b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:07.165956 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a9a5e14c-cec1-4ca6-a45a-3bca7cece17b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:07.166389 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a9a5e14c-cec1-4ca6-a45a-3bca7cece17b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:07.167289 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a9a5e14c-cec1-4ca6-a45a-3bca7cece17b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:07.167750 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a9a5e14c-cec1-4ca6-a45a-3bca7cece17b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:07.168164 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a9a5e14c-cec1-4ca6-a45a-3bca7cece17b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:07.182956 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-694cbcb3-431a-4f5c-b9bc-87bb53e81ea9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:07.184959 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-a9a5e14c-cec1-4ca6-a45a-3bca7cece17b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] HTTP exception thrown: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a9a5e14c-cec1-4ca6-a45a-3bca7cece17b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Request method failure captured: Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 HTTP/1.1 Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCImguVpKK9Zk12eHtdVnDAzA6zfNo8OXZ-0mqTIIC0_O27LWymZVUab31e13DoTMkNQDVat7VUAxDgq2dwu1DluYKlsMwAgD9IR75Z8cYk0g3ORN88-GU3_fROH_xMCR-6I2VABTKwzG5k3JT0G68Wv1gBHTdY5CH15K2YL343ThESc Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 88aa61636dd846f0a95be974b6b99d05 Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 09:00:07.186524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 09:00:07.188278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_88aa61636dd846f0a95be974b6b99d05", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:00:07.188278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:07.188278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 88aa61636dd846f0a95be974b6b99d05 Aug 26 09:00:07.188278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:07.188278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-AttachVolumeTestJSON-39276367-project Aug 26 09:00:07.188278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 09:00:07.188278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 09:00:07.188278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: b6f722499abc409a8a345bcb70114eaf Aug 26 09:00:07.188278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-AttachVolumeTestJSON-39276367-project Aug 26 09:00:07.188278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 09:00:07.188278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:07.188278 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': 'e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6'} Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:00:07.192503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. Aug 26 09:00:07.193929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:07.195895 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a9a5e14c-cec1-4ca6-a45a-3bca7cece17b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Returning 404 to user: Instance e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:00:07.195895 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a9a5e14c-cec1-4ca6-a45a-3bca7cece17b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6" status: 404 len: 111 microversion: 2.1 time: 0.033909 Aug 26 09:00:07.195895 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 514/1029] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:07 2022] GET /compute/v2.1/servers/e31a65ad-4fa0-4ef8-a334-2db7df8bc2d6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 09:00:07.201611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-694cbcb3-431a-4f5c-b9bc-87bb53e81ea9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1367 microversion: 2.1 time: 0.251364 Aug 26 09:00:07.202548 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 516/1030] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:06 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:08.225194 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f0a0f8fa-6536-4cca-8dd5-819792e0a615 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:08.225903 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f0a0f8fa-6536-4cca-8dd5-819792e0a615 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:08.234034 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0a0f8fa-6536-4cca-8dd5-819792e0a615 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:08.234730 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0a0f8fa-6536-4cca-8dd5-819792e0a615 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:08.235311 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0a0f8fa-6536-4cca-8dd5-819792e0a615 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:08.236190 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0a0f8fa-6536-4cca-8dd5-819792e0a615 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:08.236698 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0a0f8fa-6536-4cca-8dd5-819792e0a615 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:08.237169 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f0a0f8fa-6536-4cca-8dd5-819792e0a615 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:08.357351 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3c941860-ca5b-4bd9-a559-f4d028ad26a8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:08.358479 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-3c941860-ca5b-4bd9-a559-f4d028ad26a8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:08.365738 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3c941860-ca5b-4bd9-a559-f4d028ad26a8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:08.366269 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3c941860-ca5b-4bd9-a559-f4d028ad26a8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:08.366759 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3c941860-ca5b-4bd9-a559-f4d028ad26a8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:08.367934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3c941860-ca5b-4bd9-a559-f4d028ad26a8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:08.367934 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3c941860-ca5b-4bd9-a559-f4d028ad26a8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:08.368236 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-3c941860-ca5b-4bd9-a559-f4d028ad26a8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:08.384173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-3c941860-ca5b-4bd9-a559-f4d028ad26a8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] HTTP exception thrown: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3c941860-ca5b-4bd9-a559-f4d028ad26a8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Request method failure captured: Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: DELETE /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af HTTP/1.1 Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCImguVpKK9Zk12eHtdVnDAzA6zfNo8OXZ-0mqTIIC0_O27LWymZVUab31e13DoTMkNQDVat7VUAxDgq2dwu1DluYKlsMwAgD9IR75Z8cYk0g3ORN88-GU3_fROH_xMCR-6I2VABTKwzG5k3JT0G68Wv1gBHTdY5CH15K2YL343ThESc Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 88aa61636dd846f0a95be974b6b99d05 Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:00:08.385752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:00:08.387318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_88aa61636dd846f0a95be974b6b99d05", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:00:08.387318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:08.387318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 88aa61636dd846f0a95be974b6b99d05 Aug 26 09:00:08.387318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:08.387318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeTestJSON-39276367-project Aug 26 09:00:08.387318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:00:08.387318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:00:08.387318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: b6f722499abc409a8a345bcb70114eaf Aug 26 09:00:08.387318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeTestJSON-39276367-project Aug 26 09:00:08.387318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:00:08.387318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 09:00:08.387318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '18845e10-a764-495f-b6fb-9b0858c695af'} Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:00:08.388110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 09:00:08.389330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:08.390572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-3c941860-ca5b-4bd9-a559-f4d028ad26a8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Returning 404 to user: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:00:08.390572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-3c941860-ca5b-4bd9-a559-f4d028ad26a8 tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "DELETE /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 404 len: 111 microversion: 2.1 time: 0.033915 Aug 26 09:00:08.390572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 517/1031] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 09:00:08 2022] DELETE /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:00:08.390789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f0a0f8fa-6536-4cca-8dd5-819792e0a615 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:08.399097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f0a0f8fa-6536-4cca-8dd5-819792e0a615 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1367 microversion: 2.1 time: 0.178031 Aug 26 09:00:08.399689 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 515/1032] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:08 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:08.403775 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-26af6cc5-e02f-4cbb-89a0-2a1cba64cf3b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:08.405260 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-26af6cc5-e02f-4cbb-89a0-2a1cba64cf3b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] [instance: 18845e10-a764-495f-b6fb-9b0858c695af] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:08.414712 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-26af6cc5-e02f-4cbb-89a0-2a1cba64cf3b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:08.415227 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-26af6cc5-e02f-4cbb-89a0-2a1cba64cf3b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:08.415657 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-26af6cc5-e02f-4cbb-89a0-2a1cba64cf3b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:08.416386 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-26af6cc5-e02f-4cbb-89a0-2a1cba64cf3b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:08.416808 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-26af6cc5-e02f-4cbb-89a0-2a1cba64cf3b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:08.417224 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-26af6cc5-e02f-4cbb-89a0-2a1cba64cf3b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:08.431068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-26af6cc5-e02f-4cbb-89a0-2a1cba64cf3b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] HTTP exception thrown: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-26af6cc5-e02f-4cbb-89a0-2a1cba64cf3b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Request method failure captured: Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af HTTP/1.1 Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCImguVpKK9Zk12eHtdVnDAzA6zfNo8OXZ-0mqTIIC0_O27LWymZVUab31e13DoTMkNQDVat7VUAxDgq2dwu1DluYKlsMwAgD9IR75Z8cYk0g3ORN88-GU3_fROH_xMCR-6I2VABTKwzG5k3JT0G68Wv1gBHTdY5CH15K2YL343ThESc Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 88aa61636dd846f0a95be974b6b99d05 Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:00:08.432598 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:00:08.434789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_88aa61636dd846f0a95be974b6b99d05", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/88aa61636dd846f0a95be974b6b99d05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:00:08.434789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:08.434789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 88aa61636dd846f0a95be974b6b99d05 Aug 26 09:00:08.434789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeTestJSON-39276367 Aug 26 09:00:08.434789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeTestJSON-39276367-project Aug 26 09:00:08.434789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:00:08.434789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:00:08.434789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: b6f722499abc409a8a345bcb70114eaf Aug 26 09:00:08.434789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeTestJSON-39276367-project Aug 26 09:00:08.434789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:00:08.434789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 09:00:08.434789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '18845e10-a764-495f-b6fb-9b0858c695af'} Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:00:08.436246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. Aug 26 09:00:08.438644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:08.440900 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-26af6cc5-e02f-4cbb-89a0-2a1cba64cf3b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] Returning 404 to user: Instance 18845e10-a764-495f-b6fb-9b0858c695af could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:00:08.440900 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-26af6cc5-e02f-4cbb-89a0-2a1cba64cf3b tempest-AttachVolumeTestJSON-39276367 tempest-AttachVolumeTestJSON-39276367-project] 10.222.0.71 "GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af" status: 404 len: 111 microversion: 2.1 time: 0.039528 Aug 26 09:00:08.440900 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 518/1033] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:08 2022] GET /compute/v2.1/servers/18845e10-a764-495f-b6fb-9b0858c695af => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 09:00:08.872450 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-ca25cea5-ac58-4671-8fb5-69dfece711bf req-cbecdb0c-ac84-4196-9518-610b05039ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da2a1535-5e7f-4273-92e8-000a88c5f734", "name": "network-vif-plugged", "status": "completed", "tag": "c41998fb-0115-456d-88ef-ace4792ba96c"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:00:08.887427 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-ca25cea5-ac58-4671-8fb5-69dfece711bf req-cbecdb0c-ac84-4196-9518-610b05039ac9 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:08.888277 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-ca25cea5-ac58-4671-8fb5-69dfece711bf req-cbecdb0c-ac84-4196-9518-610b05039ac9 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:08.889050 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-ca25cea5-ac58-4671-8fb5-69dfece711bf req-cbecdb0c-ac84-4196-9518-610b05039ac9 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:08.906614 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-ca25cea5-ac58-4671-8fb5-69dfece711bf req-cbecdb0c-ac84-4196-9518-610b05039ac9 service nova] Creating event network-vif-plugged:c41998fb-0115-456d-88ef-ace4792ba96c for instance da2a1535-5e7f-4273-92e8-000a88c5f734 on hv-cinder-85236 Aug 26 09:00:08.922807 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-ca25cea5-ac58-4671-8fb5-69dfece711bf req-cbecdb0c-ac84-4196-9518-610b05039ac9 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060158 Aug 26 09:00:08.923729 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 516/1034] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:00:09.424254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-31f4eac8-c891-4630-b561-57618eea8950 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:09.424943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-31f4eac8-c891-4630-b561-57618eea8950 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:09.440400 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-31f4eac8-c891-4630-b561-57618eea8950 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:09.441047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-31f4eac8-c891-4630-b561-57618eea8950 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:09.441630 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-31f4eac8-c891-4630-b561-57618eea8950 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:09.442721 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-31f4eac8-c891-4630-b561-57618eea8950 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:09.443223 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-31f4eac8-c891-4630-b561-57618eea8950 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:09.443807 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-31f4eac8-c891-4630-b561-57618eea8950 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:09.721449 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-31f4eac8-c891-4630-b561-57618eea8950 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:09.730654 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-31f4eac8-c891-4630-b561-57618eea8950 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1367 microversion: 2.1 time: 0.313563 Aug 26 09:00:09.731614 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 519/1035] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:09 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:10.760954 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-54d3affc-9258-40d2-8000-626cf20fb40a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:10.761986 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-54d3affc-9258-40d2-8000-626cf20fb40a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:10.774650 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-54d3affc-9258-40d2-8000-626cf20fb40a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:10.775546 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-54d3affc-9258-40d2-8000-626cf20fb40a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:10.776598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-54d3affc-9258-40d2-8000-626cf20fb40a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:10.778073 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-54d3affc-9258-40d2-8000-626cf20fb40a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:10.778930 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-54d3affc-9258-40d2-8000-626cf20fb40a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:10.780532 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-54d3affc-9258-40d2-8000-626cf20fb40a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:11.016851 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-54d3affc-9258-40d2-8000-626cf20fb40a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:11.026928 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-54d3affc-9258-40d2-8000-626cf20fb40a tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1367 microversion: 2.1 time: 0.276350 Aug 26 09:00:11.042445 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 517/1036] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:10 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:12.054668 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d9dab17e-a3fa-4d8c-b4d0-680ecd5399a8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:12.055498 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d9dab17e-a3fa-4d8c-b4d0-680ecd5399a8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:12.063245 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d9dab17e-a3fa-4d8c-b4d0-680ecd5399a8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:12.063862 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d9dab17e-a3fa-4d8c-b4d0-680ecd5399a8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:12.064531 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d9dab17e-a3fa-4d8c-b4d0-680ecd5399a8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:12.065688 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d9dab17e-a3fa-4d8c-b4d0-680ecd5399a8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:12.068859 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d9dab17e-a3fa-4d8c-b4d0-680ecd5399a8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:12.068859 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d9dab17e-a3fa-4d8c-b4d0-680ecd5399a8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:12.290244 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-d9dab17e-a3fa-4d8c-b4d0-680ecd5399a8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:12.311419 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d9dab17e-a3fa-4d8c-b4d0-680ecd5399a8 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1556 microversion: 2.1 time: 0.261131 Aug 26 09:00:12.312860 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 520/1037] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:12 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1556 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:12.338284 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a51c26e0-45b8-4097-8311-fa1f8fc037dc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:12.339121 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a51c26e0-45b8-4097-8311-fa1f8fc037dc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:12.346692 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a51c26e0-45b8-4097-8311-fa1f8fc037dc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:12.347673 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a51c26e0-45b8-4097-8311-fa1f8fc037dc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:12.348647 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a51c26e0-45b8-4097-8311-fa1f8fc037dc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:12.349814 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a51c26e0-45b8-4097-8311-fa1f8fc037dc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:12.350334 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a51c26e0-45b8-4097-8311-fa1f8fc037dc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:12.351044 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a51c26e0-45b8-4097-8311-fa1f8fc037dc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:12.568024 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a51c26e0-45b8-4097-8311-fa1f8fc037dc tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.232901 Aug 26 09:00:12.569944 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 518/1038] 10.222.0.71 () {58 vars in 1275 bytes} [Fri Aug 26 09:00:12 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:00:14.267839 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-4dddd621-a6f5-46c0-a6c6-d393c2e1776d req-bea9ddba-505c-4ca4-b0ff-7d1c063cde45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da2a1535-5e7f-4273-92e8-000a88c5f734", "tag": "c41998fb-0115-456d-88ef-ace4792ba96c"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:00:14.287751 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-4dddd621-a6f5-46c0-a6c6-d393c2e1776d req-bea9ddba-505c-4ca4-b0ff-7d1c063cde45 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:14.288911 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-4dddd621-a6f5-46c0-a6c6-d393c2e1776d req-bea9ddba-505c-4ca4-b0ff-7d1c063cde45 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:14.289468 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-4dddd621-a6f5-46c0-a6c6-d393c2e1776d req-bea9ddba-505c-4ca4-b0ff-7d1c063cde45 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:14.306154 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-4dddd621-a6f5-46c0-a6c6-d393c2e1776d req-bea9ddba-505c-4ca4-b0ff-7d1c063cde45 service nova] Creating event network-changed:c41998fb-0115-456d-88ef-ace4792ba96c for instance da2a1535-5e7f-4273-92e8-000a88c5f734 on hv-cinder-85236 Aug 26 09:00:14.313794 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-4dddd621-a6f5-46c0-a6c6-d393c2e1776d req-bea9ddba-505c-4ca4-b0ff-7d1c063cde45 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053240 Aug 26 09:00:14.314823 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 521/1039] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:00:17.691381 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-09341dbb-b3e0-461e-b166-eb630baeb9ce tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] Calling method '.version_select at 0x7f136c142f70>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:17.763933 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-09341dbb-b3e0-461e-b166-eb630baeb9ce tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/54edf016-4458-45dc-8ee6-5a5816b7b55a" status: 200 len: 351 microversion: 2.1 time: 0.078146 Aug 26 09:00:17.764610 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 519/1040] 10.222.0.71 () {58 vars in 1245 bytes} [Fri Aug 26 09:00:17 2022] GET /compute/v2.1/os-volumes/54edf016-4458-45dc-8ee6-5a5816b7b55a => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 09:00:22.040894 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-7cf1c80c-93d9-43bd-8370-1c95da8c6de7 req-618fac5e-7841-4090-895b-a6192393ecfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b667cb3-d4d2-4c6f-857f-98953e388820", "tag": "3a68c7ab-a856-4f62-ace7-5a4ee528bca2"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:00:22.048550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4789aa14-750b-4b9f-8629-f11bf06d2ce1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:22.050492 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4789aa14-750b-4b9f-8629-f11bf06d2ce1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:22.063705 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4789aa14-750b-4b9f-8629-f11bf06d2ce1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:22.064668 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4789aa14-750b-4b9f-8629-f11bf06d2ce1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:22.065078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-7cf1c80c-93d9-43bd-8370-1c95da8c6de7 req-618fac5e-7841-4090-895b-a6192393ecfd service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:22.065343 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4789aa14-750b-4b9f-8629-f11bf06d2ce1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:22.065801 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-7cf1c80c-93d9-43bd-8370-1c95da8c6de7 req-618fac5e-7841-4090-895b-a6192393ecfd service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:22.066505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-7cf1c80c-93d9-43bd-8370-1c95da8c6de7 req-618fac5e-7841-4090-895b-a6192393ecfd service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:22.067165 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4789aa14-750b-4b9f-8629-f11bf06d2ce1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:22.067905 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4789aa14-750b-4b9f-8629-f11bf06d2ce1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:22.068559 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4789aa14-750b-4b9f-8629-f11bf06d2ce1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:22.086143 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-7cf1c80c-93d9-43bd-8370-1c95da8c6de7 req-618fac5e-7841-4090-895b-a6192393ecfd service nova] Creating event network-changed:3a68c7ab-a856-4f62-ace7-5a4ee528bca2 for instance 2b667cb3-d4d2-4c6f-857f-98953e388820 on hv-cinder-85236 Aug 26 09:00:22.101796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-7cf1c80c-93d9-43bd-8370-1c95da8c6de7 req-618fac5e-7841-4090-895b-a6192393ecfd service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060390 Aug 26 09:00:22.101796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 520/1041] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:00:22.123802 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4789aa14-750b-4b9f-8629-f11bf06d2ce1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Going to try to terminate instance {{(pid=132217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 09:00:22.265135 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4789aa14-750b-4b9f-8629-f11bf06d2ce1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "DELETE /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 204 len: 0 microversion: 2.1 time: 0.233715 Aug 26 09:00:22.271504 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 522/1042] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 09:00:22 2022] DELETE /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 09:00:22.282404 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-dc37cd8c-6fd8-48c6-8fd3-2ce3beecc58a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:22.283946 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-dc37cd8c-6fd8-48c6-8fd3-2ce3beecc58a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:22.295953 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc37cd8c-6fd8-48c6-8fd3-2ce3beecc58a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:22.296634 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc37cd8c-6fd8-48c6-8fd3-2ce3beecc58a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:22.297137 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc37cd8c-6fd8-48c6-8fd3-2ce3beecc58a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:22.298138 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc37cd8c-6fd8-48c6-8fd3-2ce3beecc58a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:22.299185 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc37cd8c-6fd8-48c6-8fd3-2ce3beecc58a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:22.301641 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-dc37cd8c-6fd8-48c6-8fd3-2ce3beecc58a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:22.484828 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-92b1a2ba-c334-458f-9fc4-d63617655bd9 tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] Calling method '.version_select at 0x7f1367e3b670>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:22.588330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-92b1a2ba-c334-458f-9fc4-d63617655bd9 tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/28ca64d7-3360-4a03-89cf-a32435612551" status: 200 len: 351 microversion: 2.1 time: 0.111223 Aug 26 09:00:22.589664 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 523/1043] 10.222.0.71 () {58 vars in 1245 bytes} [Fri Aug 26 09:00:22 2022] GET /compute/v2.1/os-volumes/28ca64d7-3360-4a03-89cf-a32435612551 => generated 351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:00:22.597559 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-dc37cd8c-6fd8-48c6-8fd3-2ce3beecc58a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:22.613720 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-dc37cd8c-6fd8-48c6-8fd3-2ce3beecc58a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.339842 Aug 26 09:00:22.614558 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 521/1044] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:22 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:23.643476 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-19c0383a-cdd6-432e-a8e6-ac5d024acfdb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:23.644277 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-19c0383a-cdd6-432e-a8e6-ac5d024acfdb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:23.655361 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-19c0383a-cdd6-432e-a8e6-ac5d024acfdb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:23.656186 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-19c0383a-cdd6-432e-a8e6-ac5d024acfdb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:23.657002 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-19c0383a-cdd6-432e-a8e6-ac5d024acfdb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:23.657931 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-19c0383a-cdd6-432e-a8e6-ac5d024acfdb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:23.658510 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-19c0383a-cdd6-432e-a8e6-ac5d024acfdb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:23.658972 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-19c0383a-cdd6-432e-a8e6-ac5d024acfdb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:23.869636 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-19c0383a-cdd6-432e-a8e6-ac5d024acfdb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:23.880068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-19c0383a-cdd6-432e-a8e6-ac5d024acfdb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.240919 Aug 26 09:00:23.880960 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 524/1045] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:23 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:24.902712 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-3cc79685-3b4e-42ee-afbb-551492c9ed9f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:24.903538 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-3cc79685-3b4e-42ee-afbb-551492c9ed9f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:24.911999 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cc79685-3b4e-42ee-afbb-551492c9ed9f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:24.912709 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cc79685-3b4e-42ee-afbb-551492c9ed9f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:24.912932 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cc79685-3b4e-42ee-afbb-551492c9ed9f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:24.913714 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cc79685-3b4e-42ee-afbb-551492c9ed9f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:24.914137 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cc79685-3b4e-42ee-afbb-551492c9ed9f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:24.914742 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-3cc79685-3b4e-42ee-afbb-551492c9ed9f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:25.078757 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-3cc79685-3b4e-42ee-afbb-551492c9ed9f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:25.089341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-3cc79685-3b4e-42ee-afbb-551492c9ed9f tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.190482 Aug 26 09:00:25.090261 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 522/1046] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:24 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:26.120493 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f98e4e00-b293-4909-a5e2-b14fbbedf0e9 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:26.121468 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f98e4e00-b293-4909-a5e2-b14fbbedf0e9 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:26.131867 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f98e4e00-b293-4909-a5e2-b14fbbedf0e9 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:26.132559 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f98e4e00-b293-4909-a5e2-b14fbbedf0e9 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:26.133063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f98e4e00-b293-4909-a5e2-b14fbbedf0e9 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:26.134191 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f98e4e00-b293-4909-a5e2-b14fbbedf0e9 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:26.134907 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f98e4e00-b293-4909-a5e2-b14fbbedf0e9 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:26.135447 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f98e4e00-b293-4909-a5e2-b14fbbedf0e9 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:26.169195 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:26.369125 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f98e4e00-b293-4909-a5e2-b14fbbedf0e9 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:26.387122 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f98e4e00-b293-4909-a5e2-b14fbbedf0e9 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.272004 Aug 26 09:00:26.388243 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 525/1047] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:26 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:27.426037 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-94871c09-550c-4232-8ff6-08a91aade10c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:27.427122 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-94871c09-550c-4232-8ff6-08a91aade10c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:27.436755 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-94871c09-550c-4232-8ff6-08a91aade10c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:27.437141 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-94871c09-550c-4232-8ff6-08a91aade10c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:27.437575 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-94871c09-550c-4232-8ff6-08a91aade10c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:27.438306 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-94871c09-550c-4232-8ff6-08a91aade10c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:27.439227 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-94871c09-550c-4232-8ff6-08a91aade10c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:27.440001 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-94871c09-550c-4232-8ff6-08a91aade10c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:27.510174 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2cd76157-3af2-46ca-a31e-bc499ea2bfea tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] Calling method '.version_select at 0x7f1367ea6670>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:27.615750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2cd76157-3af2-46ca-a31e-bc499ea2bfea tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/07aeeec5-7011-4555-bd59-c411be96a4cd" status: 200 len: 351 microversion: 2.1 time: 0.109747 Aug 26 09:00:27.617346 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 526/1048] 10.222.0.71 () {58 vars in 1245 bytes} [Fri Aug 26 09:00:27 2022] GET /compute/v2.1/os-volumes/07aeeec5-7011-4555-bd59-c411be96a4cd => generated 351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:00:27.639062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-88ed17b5-bfde-4133-af8d-63b58be20267 tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] Calling method '.version_select at 0x7f1367dd7d30>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:27.805906 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-88ed17b5-bfde-4133-af8d-63b58be20267 tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] 10.222.0.71 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.176564 Aug 26 09:00:27.807019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 527/1049] 10.222.0.71 () {58 vars in 1134 bytes} [Fri Aug 26 09:00:27 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:27.823555 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-94871c09-550c-4232-8ff6-08a91aade10c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:27.833295 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c7300a55-a5b8-4c1a-a0d9-6956294f904c tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] Calling method '.version_select at 0x7f1367ebcc10>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:27.839636 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-94871c09-550c-4232-8ff6-08a91aade10c tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1571 microversion: 2.1 time: 0.419858 Aug 26 09:00:27.840724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 523/1050] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:27 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1571 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:28.177425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c7300a55-a5b8-4c1a-a0d9-6956294f904c tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] 10.222.0.71 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.351503 Aug 26 09:00:28.178503 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 528/1051] 10.222.0.71 () {58 vars in 1149 bytes} [Fri Aug 26 09:00:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:00:28.204406 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e25f5b75-355f-41b1-92cc-7a535f14bd8a tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] Calling method '.version_select at 0x7f136c0e7700>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:28.330480 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e25f5b75-355f-41b1-92cc-7a535f14bd8a tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] 10.222.0.71 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.134221 Aug 26 09:00:28.336313 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 524/1052] 10.222.0.71 () {58 vars in 1134 bytes} [Fri Aug 26 09:00:28 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:28.351243 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-fab8382b-ffc1-4f50-91ec-dde0c8373d8a tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] Calling method '.version_select at 0x7f1367e1b5e0>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:28.494017 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-fab8382b-ffc1-4f50-91ec-dde0c8373d8a tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] 10.222.0.71 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.149091 Aug 26 09:00:28.494997 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 529/1053] 10.222.0.71 () {58 vars in 1167 bytes} [Fri Aug 26 09:00:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:00:28.514799 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-214f5ebf-1c18-4885-aff7-928323171c02 tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] Calling method '.version_select at 0x7f136c11f820>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:28.522380 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-6631dd09-5960-4f33-8906-c42327989f88 req-fbe15ef5-ec52-4d49-b0cb-8e1ac966e092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b667cb3-d4d2-4c6f-857f-98953e388820", "name": "network-vif-deleted", "tag": "3a68c7ab-a856-4f62-ace7-5a4ee528bca2"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:00:28.547087 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-6631dd09-5960-4f33-8906-c42327989f88 req-fbe15ef5-ec52-4d49-b0cb-8e1ac966e092 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:28.548510 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-6631dd09-5960-4f33-8906-c42327989f88 req-fbe15ef5-ec52-4d49-b0cb-8e1ac966e092 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:28.549237 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-6631dd09-5960-4f33-8906-c42327989f88 req-fbe15ef5-ec52-4d49-b0cb-8e1ac966e092 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:28.571727 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-6631dd09-5960-4f33-8906-c42327989f88 req-fbe15ef5-ec52-4d49-b0cb-8e1ac966e092 service nova] Creating event network-vif-deleted:3a68c7ab-a856-4f62-ace7-5a4ee528bca2 for instance 2b667cb3-d4d2-4c6f-857f-98953e388820 on hv-cinder-85236 Aug 26 09:00:28.579692 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-6631dd09-5960-4f33-8906-c42327989f88 req-fbe15ef5-ec52-4d49-b0cb-8e1ac966e092 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064122 Aug 26 09:00:28.581925 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 530/1054] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:00:28.668302 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-214f5ebf-1c18-4885-aff7-928323171c02 tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.160155 Aug 26 09:00:28.669475 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 525/1055] 10.222.0.71 () {58 vars in 1170 bytes} [Fri Aug 26 09:00:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:00:28.688314 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-51e3248d-9da8-4fa9-bca3-13b9d0ad71b1 tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] Calling method '.version_select at 0x7f1367ebc5e0>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:28.800996 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-51e3248d-9da8-4fa9-bca3-13b9d0ad71b1 tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.118547 Aug 26 09:00:28.802645 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 531/1056] 10.222.0.71 () {58 vars in 1155 bytes} [Fri Aug 26 09:00:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:28.820613 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e1eeac13-cc68-4a81-a566-d9e1cfefc048 tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] Calling method '.version_select at 0x7f136c2dc550>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:28.872485 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-47150f1e-6d07-449d-97ff-602de7bc7dd1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:28.874110 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-47150f1e-6d07-449d-97ff-602de7bc7dd1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:28.886781 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47150f1e-6d07-449d-97ff-602de7bc7dd1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:28.887314 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47150f1e-6d07-449d-97ff-602de7bc7dd1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:28.888753 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47150f1e-6d07-449d-97ff-602de7bc7dd1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:28.889863 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47150f1e-6d07-449d-97ff-602de7bc7dd1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:28.891368 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47150f1e-6d07-449d-97ff-602de7bc7dd1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:28.892327 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-47150f1e-6d07-449d-97ff-602de7bc7dd1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:29.002741 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-47150f1e-6d07-449d-97ff-602de7bc7dd1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:29.015033 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-47150f1e-6d07-449d-97ff-602de7bc7dd1 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1220 microversion: 2.1 time: 0.151785 Aug 26 09:00:29.015652 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 532/1057] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:28 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1220 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:29.051597 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e1eeac13-cc68-4a81-a566-d9e1cfefc048 tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.237022 Aug 26 09:00:29.052387 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 526/1058] 10.222.0.71 () {58 vars in 1188 bytes} [Fri Aug 26 09:00:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:00:29.069703 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1fac0629-4dbe-4b8d-95e7-6097fd3e9f07 tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] Calling method '.version_select at 0x7f1367e24dc0>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:29.228147 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1fac0629-4dbe-4b8d-95e7-6097fd3e9f07 tempest-VolumesTestJSON-1249316394 tempest-VolumesTestJSON-1249316394-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.163937 Aug 26 09:00:29.246037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 533/1059] 10.222.0.71 () {58 vars in 1155 bytes} [Fri Aug 26 09:00:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:30.053638 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2629bb3e-dbdb-455b-add3-e69c0e21a3bb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:30.054569 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2629bb3e-dbdb-455b-add3-e69c0e21a3bb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:30.056532 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:30.065632 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2629bb3e-dbdb-455b-add3-e69c0e21a3bb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:30.066489 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2629bb3e-dbdb-455b-add3-e69c0e21a3bb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:30.067569 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2629bb3e-dbdb-455b-add3-e69c0e21a3bb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:30.068878 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2629bb3e-dbdb-455b-add3-e69c0e21a3bb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:30.069745 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2629bb3e-dbdb-455b-add3-e69c0e21a3bb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:30.070522 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2629bb3e-dbdb-455b-add3-e69c0e21a3bb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:30.080219 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=75 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:30.128062 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2629bb3e-dbdb-455b-add3-e69c0e21a3bb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:30.129235 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2629bb3e-dbdb-455b-add3-e69c0e21a3bb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:30.129999 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2629bb3e-dbdb-455b-add3-e69c0e21a3bb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:30.130756 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-2629bb3e-dbdb-455b-add3-e69c0e21a3bb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lazy-loading 'fault' on Instance uuid 2b667cb3-d4d2-4c6f-857f-98953e388820 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 09:00:30.206801 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2629bb3e-dbdb-455b-add3-e69c0e21a3bb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229fe8f73e074ef89b1110da844268df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37cc63bca9274f9ba58f8a92a499a36d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:30.220943 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2629bb3e-dbdb-455b-add3-e69c0e21a3bb tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 200 len: 1225 microversion: 2.1 time: 0.173980 Aug 26 09:00:30.222026 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 527/1060] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:30 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 1225 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:31.256192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9a2a29a6-abd8-4276-a864-7fb2212c9a16 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:31.256941 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9a2a29a6-abd8-4276-a864-7fb2212c9a16 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] [instance: 2b667cb3-d4d2-4c6f-857f-98953e388820] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:31.259034 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:31.266367 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a2a29a6-abd8-4276-a864-7fb2212c9a16 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:31.266773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a2a29a6-abd8-4276-a864-7fb2212c9a16 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:31.267349 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a2a29a6-abd8-4276-a864-7fb2212c9a16 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:31.268069 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a2a29a6-abd8-4276-a864-7fb2212c9a16 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:31.268524 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a2a29a6-abd8-4276-a864-7fb2212c9a16 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:31.268959 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a2a29a6-abd8-4276-a864-7fb2212c9a16 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:31.287437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-9a2a29a6-abd8-4276-a864-7fb2212c9a16 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] HTTP exception thrown: Instance 2b667cb3-d4d2-4c6f-857f-98953e388820 could not be found. Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9a2a29a6-abd8-4276-a864-7fb2212c9a16 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Request method failure captured: Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 HTTP/1.1 Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIoiA9YHC4EwQPZNkNu1xmVs_a3iezHfMa-cRoXc4SskOOqnffg8mhyHroZ5AKSZwB40mGj5DerPTwtJ44qnAPO5uH8j3rWtIw9KYXcP0s92qsgdDKL6mz0HHkYghFUnQIXLENT0hr5h9MFqLZHPkjZ2ONNOHidjaFzSdJU1k4Of_xk Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 37cc63bca9274f9ba58f8a92a499a36d Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-TestShelveInstance-1661485776 Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:00:31.291192 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:00:31.294039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_37cc63bca9274f9ba58f8a92a499a36d", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/37cc63bca9274f9ba58f8a92a499a36d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/37cc63bca9274f9ba58f8a92a499a36d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/37cc63bca9274f9ba58f8a92a499a36d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:00:31.294039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-TestShelveInstance-1661485776 Aug 26 09:00:31.294039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 37cc63bca9274f9ba58f8a92a499a36d Aug 26 09:00:31.294039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-TestShelveInstance-1661485776 Aug 26 09:00:31.294039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-TestShelveInstance-1661485776-project Aug 26 09:00:31.294039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:00:31.294039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:00:31.294039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 229fe8f73e074ef89b1110da844268df Aug 26 09:00:31.294039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-TestShelveInstance-1661485776-project Aug 26 09:00:31.294039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:00:31.294039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance 2b667cb3-d4d2-4c6f-857f-98953e388820 could not be found. Aug 26 09:00:31.294039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '2b667cb3-d4d2-4c6f-857f-98953e388820'} Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b667cb3-d4d2-4c6f-857f-98953e388820 could not be found. Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:00:31.296005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b667cb3-d4d2-4c6f-857f-98953e388820 could not be found. Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b667cb3-d4d2-4c6f-857f-98953e388820 could not be found. Aug 26 09:00:31.299611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:31.302215 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9a2a29a6-abd8-4276-a864-7fb2212c9a16 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Returning 404 to user: Instance 2b667cb3-d4d2-4c6f-857f-98953e388820 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:00:31.302215 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9a2a29a6-abd8-4276-a864-7fb2212c9a16 tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820" status: 404 len: 111 microversion: 2.1 time: 0.043007 Aug 26 09:00:31.302215 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 534/1061] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:00:31 2022] GET /compute/v2.1/servers/2b667cb3-d4d2-4c6f-857f-98953e388820 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:00:31.562005 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b1395c6e-d064-43d8-9ee6-c8bed28d7b6a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] Calling method '.version_select at 0x7f136c1423a0>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:31.608189 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b1395c6e-d064-43d8-9ee6-c8bed28d7b6a tempest-TestShelveInstance-1661485776 tempest-TestShelveInstance-1661485776-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1673214775" status: 202 len: 0 microversion: 2.1 time: 0.054956 Aug 26 09:00:31.614276 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 528/1062] 10.222.0.71 () {58 vars in 1254 bytes} [Fri Aug 26 09:00:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1673214775 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 09:00:50.567414 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-84f895d9-4b33-4219-8d3c-710612e3f903 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:50.569642 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-84f895d9-4b33-4219-8d3c-710612e3f903 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:50.576351 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=12 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:50.577166 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:50.579572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84f895d9-4b33-4219-8d3c-710612e3f903 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:50.579572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84f895d9-4b33-4219-8d3c-710612e3f903 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:50.579947 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84f895d9-4b33-4219-8d3c-710612e3f903 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:50.580682 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84f895d9-4b33-4219-8d3c-710612e3f903 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:50.581093 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84f895d9-4b33-4219-8d3c-710612e3f903 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:50.581552 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-84f895d9-4b33-4219-8d3c-710612e3f903 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:50.615240 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-84f895d9-4b33-4219-8d3c-710612e3f903 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051878 Aug 26 09:00:50.615831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 535/1063] 10.222.0.71 () {60 vars in 1343 bytes} [Fri Aug 26 09:00:50 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:00:50.688137 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6f9c567d-e2b0-4624-a9fa-07504b794213 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:50.689037 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6f9c567d-e2b0-4624-a9fa-07504b794213 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:50.691075 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=7 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:50.692113 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:00:50.699250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6f9c567d-e2b0-4624-a9fa-07504b794213 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:50.699741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6f9c567d-e2b0-4624-a9fa-07504b794213 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:50.700236 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6f9c567d-e2b0-4624-a9fa-07504b794213 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:50.700925 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6f9c567d-e2b0-4624-a9fa-07504b794213 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:50.701376 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6f9c567d-e2b0-4624-a9fa-07504b794213 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:50.701987 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6f9c567d-e2b0-4624-a9fa-07504b794213 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:50.743423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6f9c567d-e2b0-4624-a9fa-07504b794213 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 09:00:50.854134 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6f9c567d-e2b0-4624-a9fa-07504b794213 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "DELETE /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 204 len: 0 microversion: 2.20 time: 0.169652 Aug 26 09:00:50.855025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 529/1064] 10.222.0.71 () {60 vars in 1280 bytes} [Fri Aug 26 09:00:50 2022] DELETE /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 09:00:50.864085 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-86e740d2-8d27-48d4-8047-1c677863eb10 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:50.865062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-86e740d2-8d27-48d4-8047-1c677863eb10 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:50.874547 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-86e740d2-8d27-48d4-8047-1c677863eb10 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:50.875280 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-86e740d2-8d27-48d4-8047-1c677863eb10 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:50.875694 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-86e740d2-8d27-48d4-8047-1c677863eb10 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:50.876767 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-86e740d2-8d27-48d4-8047-1c677863eb10 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:50.881578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-86e740d2-8d27-48d4-8047-1c677863eb10 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:50.882179 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-86e740d2-8d27-48d4-8047-1c677863eb10 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:51.058317 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-86e740d2-8d27-48d4-8047-1c677863eb10 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:51.068706 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-86e740d2-8d27-48d4-8047-1c677863eb10 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:51.070527 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-86e740d2-8d27-48d4-8047-1c677863eb10 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:51.072350 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-86e740d2-8d27-48d4-8047-1c677863eb10 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.212355 Aug 26 09:00:51.073072 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 536/1065] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 09:00:50 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 09:00:52.099743 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c227861d-43b2-4095-b0bd-a36add745356 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:52.102878 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c227861d-43b2-4095-b0bd-a36add745356 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:52.123024 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c227861d-43b2-4095-b0bd-a36add745356 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:52.123756 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c227861d-43b2-4095-b0bd-a36add745356 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:52.124267 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c227861d-43b2-4095-b0bd-a36add745356 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:52.125244 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c227861d-43b2-4095-b0bd-a36add745356 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:52.125775 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c227861d-43b2-4095-b0bd-a36add745356 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:52.126262 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c227861d-43b2-4095-b0bd-a36add745356 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:52.362441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c227861d-43b2-4095-b0bd-a36add745356 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:52.380828 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c227861d-43b2-4095-b0bd-a36add745356 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:52.383105 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-c227861d-43b2-4095-b0bd-a36add745356 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:52.384453 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c227861d-43b2-4095-b0bd-a36add745356 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.289850 Aug 26 09:00:52.387074 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 530/1066] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 09:00:52 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 09:00:53.412140 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8725b36a-1aa8-4aef-acb7-4ae7ec3f41d3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:53.412816 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8725b36a-1aa8-4aef-acb7-4ae7ec3f41d3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:53.429352 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8725b36a-1aa8-4aef-acb7-4ae7ec3f41d3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:53.430780 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8725b36a-1aa8-4aef-acb7-4ae7ec3f41d3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:53.431406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8725b36a-1aa8-4aef-acb7-4ae7ec3f41d3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:53.433239 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8725b36a-1aa8-4aef-acb7-4ae7ec3f41d3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:53.434039 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8725b36a-1aa8-4aef-acb7-4ae7ec3f41d3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:53.434736 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8725b36a-1aa8-4aef-acb7-4ae7ec3f41d3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:53.862085 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8725b36a-1aa8-4aef-acb7-4ae7ec3f41d3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:53.884373 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8725b36a-1aa8-4aef-acb7-4ae7ec3f41d3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:53.886978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8725b36a-1aa8-4aef-acb7-4ae7ec3f41d3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:53.890726 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8725b36a-1aa8-4aef-acb7-4ae7ec3f41d3 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1722 microversion: 2.20 time: 0.482220 Aug 26 09:00:53.891674 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 537/1067] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 09:00:53 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1722 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 09:00:54.923578 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-6c7b1da8-9953-41f5-91f2-19be3dabb03e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:54.929077 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-6c7b1da8-9953-41f5-91f2-19be3dabb03e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:54.959130 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6c7b1da8-9953-41f5-91f2-19be3dabb03e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:54.959762 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6c7b1da8-9953-41f5-91f2-19be3dabb03e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:54.960229 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6c7b1da8-9953-41f5-91f2-19be3dabb03e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:54.961123 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6c7b1da8-9953-41f5-91f2-19be3dabb03e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:54.961968 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6c7b1da8-9953-41f5-91f2-19be3dabb03e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:54.962418 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-6c7b1da8-9953-41f5-91f2-19be3dabb03e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:55.188856 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-0758f06f-a1ba-4e5b-b1ba-daf8adbde363 req-0aebece0-869d-4b44-a801-f6a2c106f91f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbfe1e03-de30-4198-9a4d-a96708dbb98b", "name": "network-vif-deleted", "tag": "57b16be7-70f7-4545-b557-e106d767a915"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:00:55.189530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6c7b1da8-9953-41f5-91f2-19be3dabb03e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:55.209012 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-0758f06f-a1ba-4e5b-b1ba-daf8adbde363 req-0aebece0-869d-4b44-a801-f6a2c106f91f service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:55.209834 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-0758f06f-a1ba-4e5b-b1ba-daf8adbde363 req-0aebece0-869d-4b44-a801-f6a2c106f91f service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:55.210522 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6c7b1da8-9953-41f5-91f2-19be3dabb03e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:55.210739 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-0758f06f-a1ba-4e5b-b1ba-daf8adbde363 req-0aebece0-869d-4b44-a801-f6a2c106f91f service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:55.213102 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-6c7b1da8-9953-41f5-91f2-19be3dabb03e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63e1c5a24be04ca4abd5d5109c5763f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed7993eba324f94a1b0f7fc23401f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:00:55.216938 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-6c7b1da8-9953-41f5-91f2-19be3dabb03e tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 200 len: 1655 microversion: 2.20 time: 0.301374 Aug 26 09:00:55.231199 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 531/1068] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 09:00:54 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 1655 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 09:00:55.548125 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-0758f06f-a1ba-4e5b-b1ba-daf8adbde363 req-0aebece0-869d-4b44-a801-f6a2c106f91f service nova] Creating event network-vif-deleted:57b16be7-70f7-4545-b557-e106d767a915 for instance cbfe1e03-de30-4198-9a4d-a96708dbb98b on hv-cinder-85236 Aug 26 09:00:55.566614 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-0758f06f-a1ba-4e5b-b1ba-daf8adbde363 req-0aebece0-869d-4b44-a801-f6a2c106f91f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.379359 Aug 26 09:00:55.570058 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 538/1069] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:00:56.257135 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4053ce97-d7c8-4b6b-9f09-179eecd5b007 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:56.258023 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4053ce97-d7c8-4b6b-9f09-179eecd5b007 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:56.291159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4053ce97-d7c8-4b6b-9f09-179eecd5b007 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:56.291662 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4053ce97-d7c8-4b6b-9f09-179eecd5b007 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:56.292105 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4053ce97-d7c8-4b6b-9f09-179eecd5b007 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:56.292838 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4053ce97-d7c8-4b6b-9f09-179eecd5b007 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:56.293336 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4053ce97-d7c8-4b6b-9f09-179eecd5b007 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:56.293797 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4053ce97-d7c8-4b6b-9f09-179eecd5b007 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:56.342405 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-4053ce97-d7c8-4b6b-9f09-179eecd5b007 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] HTTP exception thrown: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4053ce97-d7c8-4b6b-9f09-179eecd5b007 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Request method failure captured: Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b HTTP/1.1 Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCImqwYI1puUrXBaVS0u8EIJAhXUypyZcgYcA6hR1_JGaV3vf4CttppK3hMXMvRnUMW2vCCVwt7eo62btClLXsaXiR7f7_uyq0-OdwjLUTE6xxp6IvybejR_0XnDaPC9Dlnj0KBs_lKg_n15wEqhzCuu0hRhlSR7e-Wj6vnH9GPPvc0o Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 8ed7993eba324f94a1b0f7fc23401f0f Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 09:00:56.345341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 09:00:56.347503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_8ed7993eba324f94a1b0f7fc23401f0f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:00:56.347503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:00:56.347503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 8ed7993eba324f94a1b0f7fc23401f0f Aug 26 09:00:56.347503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:00:56.347503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-AttachVolumeShelveTestJSON-648548185-project Aug 26 09:00:56.347503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 09:00:56.347503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 09:00:56.347503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 63e1c5a24be04ca4abd5d5109c5763f8 Aug 26 09:00:56.347503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-AttachVolumeShelveTestJSON-648548185-project Aug 26 09:00:56.347503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 09:00:56.347503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:56.347503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': 'cbfe1e03-de30-4198-9a4d-a96708dbb98b'} Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:00:56.348581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:56.351701 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:00:56.355341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4053ce97-d7c8-4b6b-9f09-179eecd5b007 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Returning 404 to user: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:00:56.355341 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4053ce97-d7c8-4b6b-9f09-179eecd5b007 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 404 len: 111 microversion: 2.20 time: 0.102417 Aug 26 09:00:56.373878 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-576bbd5c-a089-4c04-bee5-b8a81b908002 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '.version_select at 0x7f1367e2d0d0>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:56.374543 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 532/1070] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 09:00:56 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 09:00:56.427940 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-576bbd5c-a089-4c04-bee5-b8a81b908002 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813474503" status: 204 len: 0 microversion: 2.20 time: 0.063876 Aug 26 09:00:56.430113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 539/1071] 10.222.0.71 () {60 vars in 1262 bytes} [Fri Aug 26 09:00:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813474503 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 09:00:59.541985 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ab93686f-7416-4e0e-92bc-483c74df9043 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:59.543184 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ab93686f-7416-4e0e-92bc-483c74df9043 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:59.570319 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab93686f-7416-4e0e-92bc-483c74df9043 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:59.571517 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab93686f-7416-4e0e-92bc-483c74df9043 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:59.573186 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab93686f-7416-4e0e-92bc-483c74df9043 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:59.575822 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab93686f-7416-4e0e-92bc-483c74df9043 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:59.579011 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab93686f-7416-4e0e-92bc-483c74df9043 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:59.579872 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ab93686f-7416-4e0e-92bc-483c74df9043 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:59.622324 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-ab93686f-7416-4e0e-92bc-483c74df9043 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] HTTP exception thrown: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ab93686f-7416-4e0e-92bc-483c74df9043 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Request method failure captured: Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: DELETE /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b HTTP/1.1 Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCImqwYI1puUrXBaVS0u8EIJAhXUypyZcgYcA6hR1_JGaV3vf4CttppK3hMXMvRnUMW2vCCVwt7eo62btClLXsaXiR7f7_uyq0-OdwjLUTE6xxp6IvybejR_0XnDaPC9Dlnj0KBs_lKg_n15wEqhzCuu0hRhlSR7e-Wj6vnH9GPPvc0o Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 8ed7993eba324f94a1b0f7fc23401f0f Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:00:59.627831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:00:59.632113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_8ed7993eba324f94a1b0f7fc23401f0f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:00:59.632113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:00:59.632113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 8ed7993eba324f94a1b0f7fc23401f0f Aug 26 09:00:59.632113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:00:59.632113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeShelveTestJSON-648548185-project Aug 26 09:00:59.632113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:00:59.632113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:00:59.632113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 63e1c5a24be04ca4abd5d5109c5763f8 Aug 26 09:00:59.632113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeShelveTestJSON-648548185-project Aug 26 09:00:59.632113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:00:59.632113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:59.632113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': 'cbfe1e03-de30-4198-9a4d-a96708dbb98b'} Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:00:59.633272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:59.637047 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:59.641061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ab93686f-7416-4e0e-92bc-483c74df9043 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Returning 404 to user: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:00:59.641061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ab93686f-7416-4e0e-92bc-483c74df9043 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "DELETE /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 404 len: 111 microversion: 2.20 time: 0.101462 Aug 26 09:00:59.641061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 540/1072] 10.222.0.71 () {60 vars in 1280 bytes} [Fri Aug 26 09:00:59 2022] DELETE /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 26 09:00:59.651284 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-62353a6f-d7f9-413b-ad6c-4b69a41d4b06 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:00:59.651901 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-62353a6f-d7f9-413b-ad6c-4b69a41d4b06 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: cbfe1e03-de30-4198-9a4d-a96708dbb98b] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:00:59.665582 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-62353a6f-d7f9-413b-ad6c-4b69a41d4b06 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:59.666146 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-62353a6f-d7f9-413b-ad6c-4b69a41d4b06 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:59.666581 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-62353a6f-d7f9-413b-ad6c-4b69a41d4b06 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:59.667408 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-62353a6f-d7f9-413b-ad6c-4b69a41d4b06 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:00:59.667864 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-62353a6f-d7f9-413b-ad6c-4b69a41d4b06 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:00:59.668332 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-62353a6f-d7f9-413b-ad6c-4b69a41d4b06 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:00:59.698664 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b566e819-a82e-4445-9071-d6a6e530b5dc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Action: 'create', calling method: .version_select at 0x7f136c2ab820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-484925391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSMkfz+iPDZXS/OS/QhjsBJWgVtOAiauXhzKOeML/gMT1LOpchj8YMIIOR5PEZPDx0wpBUG6uUYme+oooNe96HV3BLQjgT6WzqS13PgYXwqorRDRziyYl1Cp3fcoO1/Pw=="}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:00:59.702322 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-62353a6f-d7f9-413b-ad6c-4b69a41d4b06 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] HTTP exception thrown: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-62353a6f-d7f9-413b-ad6c-4b69a41d4b06 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Request method failure captured: Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b HTTP/1.1 Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCImqwYI1puUrXBaVS0u8EIJAhXUypyZcgYcA6hR1_JGaV3vf4CttppK3hMXMvRnUMW2vCCVwt7eo62btClLXsaXiR7f7_uyq0-OdwjLUTE6xxp6IvybejR_0XnDaPC9Dlnj0KBs_lKg_n15wEqhzCuu0hRhlSR7e-Wj6vnH9GPPvc0o Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 8ed7993eba324f94a1b0f7fc23401f0f Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:00:59.704308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:00:59.707315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_8ed7993eba324f94a1b0f7fc23401f0f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:00:59.707315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:00:59.707315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 8ed7993eba324f94a1b0f7fc23401f0f Aug 26 09:00:59.707315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:00:59.707315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeShelveTestJSON-648548185-project Aug 26 09:00:59.707315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:00:59.707315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:00:59.707315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 63e1c5a24be04ca4abd5d5109c5763f8 Aug 26 09:00:59.707315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeShelveTestJSON-648548185-project Aug 26 09:00:59.707315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:00:59.707315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:59.707315 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': 'cbfe1e03-de30-4198-9a4d-a96708dbb98b'} Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:00:59.709062 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. Aug 26 09:00:59.711978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:00:59.714635 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-62353a6f-d7f9-413b-ad6c-4b69a41d4b06 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Returning 404 to user: Instance cbfe1e03-de30-4198-9a4d-a96708dbb98b could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:00:59.714635 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-62353a6f-d7f9-413b-ad6c-4b69a41d4b06 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b" status: 404 len: 111 microversion: 2.20 time: 0.060150 Aug 26 09:00:59.714635 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 541/1073] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 09:00:59 2022] GET /compute/v2.1/servers/cbfe1e03-de30-4198-9a4d-a96708dbb98b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 09:00:59.743826 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-b566e819-a82e-4445-9071-d6a6e530b5dc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Getting quotas for project 6773ba16da8845d39c90a627802cf05f. Resources: {'key_pairs'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 09:00:59.758620 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-b566e819-a82e-4445-9071-d6a6e530b5dc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Getting quotas for user 34eaab912a91496daeedbaf63f5ddcbb and project 6773ba16da8845d39c90a627802cf05f. Resources: {'key_pairs'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 09:00:59.838800 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b566e819-a82e-4445-9071-d6a6e530b5dc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.621622 Aug 26 09:00:59.841577 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 533/1074] 10.222.0.71 () {60 vars in 1159 bytes} [Fri Aug 26 09:00:59 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:01:01.043289 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-cb490442-4511-49dd-8350-17174bc053d9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:01.045020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-cb490442-4511-49dd-8350-17174bc053d9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:01.061418 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cb490442-4511-49dd-8350-17174bc053d9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:01.063014 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cb490442-4511-49dd-8350-17174bc053d9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:01.064431 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cb490442-4511-49dd-8350-17174bc053d9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:01.066189 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cb490442-4511-49dd-8350-17174bc053d9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:01.067608 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cb490442-4511-49dd-8350-17174bc053d9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:01.068994 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cb490442-4511-49dd-8350-17174bc053d9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:01.111108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-cb490442-4511-49dd-8350-17174bc053d9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] HTTP exception thrown: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-cb490442-4511-49dd-8350-17174bc053d9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Request method failure captured: Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: DELETE /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa HTTP/1.1 Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCImqwYI1puUrXBaVS0u8EIJAhXUypyZcgYcA6hR1_JGaV3vf4CttppK3hMXMvRnUMW2vCCVwt7eo62btClLXsaXiR7f7_uyq0-OdwjLUTE6xxp6IvybejR_0XnDaPC9Dlnj0KBs_lKg_n15wEqhzCuu0hRhlSR7e-Wj6vnH9GPPvc0o Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 8ed7993eba324f94a1b0f7fc23401f0f Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:01:01.114601 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:01:01.116833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_8ed7993eba324f94a1b0f7fc23401f0f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:01.116833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:01:01.116833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 8ed7993eba324f94a1b0f7fc23401f0f Aug 26 09:01:01.116833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:01:01.116833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeShelveTestJSON-648548185-project Aug 26 09:01:01.116833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:01:01.116833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:01:01.116833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 63e1c5a24be04ca4abd5d5109c5763f8 Aug 26 09:01:01.116833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeShelveTestJSON-648548185-project Aug 26 09:01:01.116833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:01:01.116833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 09:01:01.116833 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '8de0d2d4-3218-426b-a548-91c5891780fa'} Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:01.117756 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 09:01:01.119425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:01.131711 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-cb490442-4511-49dd-8350-17174bc053d9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Returning 404 to user: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:01.131711 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-cb490442-4511-49dd-8350-17174bc053d9 tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "DELETE /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 404 len: 111 microversion: 2.20 time: 0.096484 Aug 26 09:01:01.131711 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 542/1075] 10.222.0.71 () {60 vars in 1280 bytes} [Fri Aug 26 09:01:01 2022] DELETE /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 26 09:01:01.156264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-866c58b9-cfc8-43d9-b152-dfd1b277884b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:01.161337 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-866c58b9-cfc8-43d9-b152-dfd1b277884b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] [instance: 8de0d2d4-3218-426b-a548-91c5891780fa] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:01.177006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-866c58b9-cfc8-43d9-b152-dfd1b277884b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:01.177920 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-866c58b9-cfc8-43d9-b152-dfd1b277884b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:01.178686 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-866c58b9-cfc8-43d9-b152-dfd1b277884b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:01.179848 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-866c58b9-cfc8-43d9-b152-dfd1b277884b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:01.180676 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-866c58b9-cfc8-43d9-b152-dfd1b277884b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:01.181678 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-866c58b9-cfc8-43d9-b152-dfd1b277884b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:01.223256 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-866c58b9-cfc8-43d9-b152-dfd1b277884b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] HTTP exception thrown: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-866c58b9-cfc8-43d9-b152-dfd1b277884b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Request method failure captured: Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa HTTP/1.1 Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCImqwYI1puUrXBaVS0u8EIJAhXUypyZcgYcA6hR1_JGaV3vf4CttppK3hMXMvRnUMW2vCCVwt7eo62btClLXsaXiR7f7_uyq0-OdwjLUTE6xxp6IvybejR_0XnDaPC9Dlnj0KBs_lKg_n15wEqhzCuu0hRhlSR7e-Wj6vnH9GPPvc0o Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 8ed7993eba324f94a1b0f7fc23401f0f Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 09:01:01.223789 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 09:01:01.226377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_8ed7993eba324f94a1b0f7fc23401f0f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/8ed7993eba324f94a1b0f7fc23401f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:01.226377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:01:01.226377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 8ed7993eba324f94a1b0f7fc23401f0f Aug 26 09:01:01.226377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-648548185 Aug 26 09:01:01.226377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-AttachVolumeShelveTestJSON-648548185-project Aug 26 09:01:01.226377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 09:01:01.226377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 09:01:01.226377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 63e1c5a24be04ca4abd5d5109c5763f8 Aug 26 09:01:01.226377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-AttachVolumeShelveTestJSON-648548185-project Aug 26 09:01:01.226377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 09:01:01.226377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 09:01:01.226377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': '8de0d2d4-3218-426b-a548-91c5891780fa'} Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:01.228964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. Aug 26 09:01:01.232006 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:01.233967 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-866c58b9-cfc8-43d9-b152-dfd1b277884b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] Returning 404 to user: Instance 8de0d2d4-3218-426b-a548-91c5891780fa could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:01.233967 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-866c58b9-cfc8-43d9-b152-dfd1b277884b tempest-AttachVolumeShelveTestJSON-648548185 tempest-AttachVolumeShelveTestJSON-648548185-project] 10.222.0.71 "GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa" status: 404 len: 111 microversion: 2.20 time: 0.086972 Aug 26 09:01:01.235023 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 534/1076] 10.222.0.71 () {60 vars in 1277 bytes} [Fri Aug 26 09:01:01 2022] GET /compute/v2.1/servers/8de0d2d4-3218-426b-a548-91c5891780fa => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 26 09:01:09.506007 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-463383163", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "networks": [{"uuid": "0ee037e3-9323-4dcd-a48f-6da1ecb6f1f9"}]}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:01:09.570343 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.network.neutron [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] validate_networks() for [('0ee037e3-9323-4dcd-a48f-6da1ecb6f1f9', None, None, None, None, None)] {{(pid=132217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 09:01:09.832367 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8bbc1a5f-f76c-4ce9-b3df-0fed4f869269 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:09.832943 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8bbc1a5f-f76c-4ce9-b3df-0fed4f869269 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:09.835663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=4 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:09.843015 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8bbc1a5f-f76c-4ce9-b3df-0fed4f869269 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:09.843703 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8bbc1a5f-f76c-4ce9-b3df-0fed4f869269 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:09.844525 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8bbc1a5f-f76c-4ce9-b3df-0fed4f869269 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:09.845397 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8bbc1a5f-f76c-4ce9-b3df-0fed4f869269 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:09.845869 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8bbc1a5f-f76c-4ce9-b3df-0fed4f869269 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:09.846288 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8bbc1a5f-f76c-4ce9-b3df-0fed4f869269 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:09.873401 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8bbc1a5f-f76c-4ce9-b3df-0fed4f869269 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734/ips" status: 200 len: 148 microversion: 2.1 time: 0.045036 Aug 26 09:01:09.874538 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 535/1077] 10.222.0.71 () {58 vars in 1248 bytes} [Fri Aug 26 09:01:09 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734/ips => generated 148 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 09:01:10.003474 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Flavor limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 09:01:10.004157 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Image limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 09:01:10.005493 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Flavor pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 09:01:10.006119 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Image pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 09:01:10.006801 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 09:01:10.018499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:10.019212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:10.019811 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:10.021516 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:10.021780 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:10.022009 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:10.040974 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Getting quotas for project eed42d5a00d44ae3af1d74159e20c616. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 09:01:10.047887 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Getting quotas for user d5e175245f2e48c79d5f82dbaf4f1cf4 and project eed42d5a00d44ae3af1d74159e20c616. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 09:01:10.065186 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Going to run 1 instances... {{(pid=132217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 09:01:10.067735 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 09:01:10.124368 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4773b98a-3c4d-46d5-9b6b-e012f7297d11 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623322 Aug 26 09:01:10.125620 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 543/1078] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 09:01:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 09:01:10.137537 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f595d086-f84b-4fab-92e2-590d02bb588b tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:10.138223 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f595d086-f84b-4fab-92e2-590d02bb588b tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:10.233091 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f595d086-f84b-4fab-92e2-590d02bb588b tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:10.246623 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f595d086-f84b-4fab-92e2-590d02bb588b tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1218 microversion: 2.1 time: 0.113395 Aug 26 09:01:10.247602 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 536/1079] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:10 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:11.273469 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6a01d9a2-c931-4a06-a25a-e3b645d137b7 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:11.274118 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6a01d9a2-c931-4a06-a25a-e3b645d137b7 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:11.281283 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6a01d9a2-c931-4a06-a25a-e3b645d137b7 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:11.281778 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6a01d9a2-c931-4a06-a25a-e3b645d137b7 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:11.282222 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6a01d9a2-c931-4a06-a25a-e3b645d137b7 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:11.282938 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6a01d9a2-c931-4a06-a25a-e3b645d137b7 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:11.283404 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6a01d9a2-c931-4a06-a25a-e3b645d137b7 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:11.283837 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6a01d9a2-c931-4a06-a25a-e3b645d137b7 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:11.365221 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a5ecae68-a76d-486c-bc85-6c041b0f056f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8abf2f0c-b811-40c5-867d-37837a9af362"}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:01:11.378467 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a5ecae68-a76d-486c-bc85-6c041b0f056f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:11.379095 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6a01d9a2-c931-4a06-a25a-e3b645d137b7 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:11.387118 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5ecae68-a76d-486c-bc85-6c041b0f056f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:11.387777 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6a01d9a2-c931-4a06-a25a-e3b645d137b7 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1270 microversion: 2.1 time: 0.120364 Aug 26 09:01:11.387899 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5ecae68-a76d-486c-bc85-6c041b0f056f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:11.388364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 544/1080] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:11 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1270 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:11.388580 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5ecae68-a76d-486c-bc85-6c041b0f056f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:11.389699 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5ecae68-a76d-486c-bc85-6c041b0f056f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:11.390272 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5ecae68-a76d-486c-bc85-6c041b0f056f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:11.390969 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a5ecae68-a76d-486c-bc85-6c041b0f056f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:11.787969 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a5ecae68-a76d-486c-bc85-6c041b0f056f tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "POST /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426241 Aug 26 09:01:11.789290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 537/1081] 10.222.0.71 () {60 vars in 1323 bytes} [Fri Aug 26 09:01:11 2022] POST /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:01:12.417868 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0653b296-be42-40c8-bb30-1ac3450c372a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:12.418720 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-0653b296-be42-40c8-bb30-1ac3450c372a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:12.426029 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0653b296-be42-40c8-bb30-1ac3450c372a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:12.426985 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0653b296-be42-40c8-bb30-1ac3450c372a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:12.427635 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0653b296-be42-40c8-bb30-1ac3450c372a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:12.428641 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0653b296-be42-40c8-bb30-1ac3450c372a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:12.429353 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0653b296-be42-40c8-bb30-1ac3450c372a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:12.430000 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0653b296-be42-40c8-bb30-1ac3450c372a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:12.629307 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0653b296-be42-40c8-bb30-1ac3450c372a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:12.642737 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-0653b296-be42-40c8-bb30-1ac3450c372a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1318 microversion: 2.1 time: 0.228967 Aug 26 09:01:12.643790 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 545/1082] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:12 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:13.417752 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-4699f1bc-02ac-4a73-bb9a-30d0367ff1d2 req-a13f2064-4469-4636-a2a8-c92191a12cfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e87910c-37ab-43c9-b76d-957282257a15", "tag": "6b259d13-3e81-43ea-89d3-6f544e3628b0"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:01:13.433178 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-4699f1bc-02ac-4a73-bb9a-30d0367ff1d2 req-a13f2064-4469-4636-a2a8-c92191a12cfb service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:13.434631 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-4699f1bc-02ac-4a73-bb9a-30d0367ff1d2 req-a13f2064-4469-4636-a2a8-c92191a12cfb service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:13.435140 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-4699f1bc-02ac-4a73-bb9a-30d0367ff1d2 req-a13f2064-4469-4636-a2a8-c92191a12cfb service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:13.451284 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-4699f1bc-02ac-4a73-bb9a-30d0367ff1d2 req-a13f2064-4469-4636-a2a8-c92191a12cfb service nova] Creating event network-changed:6b259d13-3e81-43ea-89d3-6f544e3628b0 for instance 3e87910c-37ab-43c9-b76d-957282257a15 on hv-cinder-85236 Aug 26 09:01:13.456505 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-4699f1bc-02ac-4a73-bb9a-30d0367ff1d2 req-a13f2064-4469-4636-a2a8-c92191a12cfb service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043466 Aug 26 09:01:13.457394 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 538/1083] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:01:13.673002 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-00b1c970-0f26-4581-9052-aaf1d26c6f5e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:13.673002 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-00b1c970-0f26-4581-9052-aaf1d26c6f5e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:13.679547 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00b1c970-0f26-4581-9052-aaf1d26c6f5e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:13.680137 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00b1c970-0f26-4581-9052-aaf1d26c6f5e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:13.680645 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00b1c970-0f26-4581-9052-aaf1d26c6f5e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:13.681404 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00b1c970-0f26-4581-9052-aaf1d26c6f5e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:13.682063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00b1c970-0f26-4581-9052-aaf1d26c6f5e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:13.682535 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00b1c970-0f26-4581-9052-aaf1d26c6f5e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:13.857120 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-00b1c970-0f26-4581-9052-aaf1d26c6f5e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:13.866128 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-00b1c970-0f26-4581-9052-aaf1d26c6f5e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1318 microversion: 2.1 time: 0.199847 Aug 26 09:01:13.868779 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 546/1084] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:13 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:14.892270 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-71a34d7e-5a48-497a-9bac-21da693dbe79 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:14.893119 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-71a34d7e-5a48-497a-9bac-21da693dbe79 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:14.900449 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-71a34d7e-5a48-497a-9bac-21da693dbe79 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:14.900859 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-71a34d7e-5a48-497a-9bac-21da693dbe79 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:14.901285 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-71a34d7e-5a48-497a-9bac-21da693dbe79 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:14.902029 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-71a34d7e-5a48-497a-9bac-21da693dbe79 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:14.902447 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-71a34d7e-5a48-497a-9bac-21da693dbe79 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:14.902863 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-71a34d7e-5a48-497a-9bac-21da693dbe79 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:15.138065 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-71a34d7e-5a48-497a-9bac-21da693dbe79 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:15.148369 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-71a34d7e-5a48-497a-9bac-21da693dbe79 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1318 microversion: 2.1 time: 0.260496 Aug 26 09:01:15.149113 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 539/1085] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:14 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:16.170763 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-ffd83405-217c-4310-ac44-7fdd17f339ca tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:16.176019 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-ffd83405-217c-4310-ac44-7fdd17f339ca tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:16.186553 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ffd83405-217c-4310-ac44-7fdd17f339ca tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:16.187268 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ffd83405-217c-4310-ac44-7fdd17f339ca tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:16.187757 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ffd83405-217c-4310-ac44-7fdd17f339ca tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:16.188570 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ffd83405-217c-4310-ac44-7fdd17f339ca tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:16.188918 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ffd83405-217c-4310-ac44-7fdd17f339ca tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:16.189327 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-ffd83405-217c-4310-ac44-7fdd17f339ca tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:16.341877 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-ffd83405-217c-4310-ac44-7fdd17f339ca tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:16.351134 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-ffd83405-217c-4310-ac44-7fdd17f339ca tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1318 microversion: 2.1 time: 0.184675 Aug 26 09:01:16.351721 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 547/1086] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:16 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:17.372565 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-eb63f463-fa84-4daf-ac1b-47428ae62c97 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:17.373441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-eb63f463-fa84-4daf-ac1b-47428ae62c97 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:17.380860 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eb63f463-fa84-4daf-ac1b-47428ae62c97 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:17.381361 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eb63f463-fa84-4daf-ac1b-47428ae62c97 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:17.381790 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eb63f463-fa84-4daf-ac1b-47428ae62c97 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:17.382503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eb63f463-fa84-4daf-ac1b-47428ae62c97 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:17.382975 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eb63f463-fa84-4daf-ac1b-47428ae62c97 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:17.383394 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-eb63f463-fa84-4daf-ac1b-47428ae62c97 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:17.536327 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-eb63f463-fa84-4daf-ac1b-47428ae62c97 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:17.544639 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-eb63f463-fa84-4daf-ac1b-47428ae62c97 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1318 microversion: 2.1 time: 0.175935 Aug 26 09:01:17.545270 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 540/1087] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:17 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:18.567888 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-784a796a-f906-4ba8-be93-00eeb484d63d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:18.568539 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-784a796a-f906-4ba8-be93-00eeb484d63d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:18.575795 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-784a796a-f906-4ba8-be93-00eeb484d63d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:18.576272 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-784a796a-f906-4ba8-be93-00eeb484d63d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:18.576878 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-784a796a-f906-4ba8-be93-00eeb484d63d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:18.577390 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-784a796a-f906-4ba8-be93-00eeb484d63d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:18.577829 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-784a796a-f906-4ba8-be93-00eeb484d63d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:18.578238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-784a796a-f906-4ba8-be93-00eeb484d63d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:18.736285 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-784a796a-f906-4ba8-be93-00eeb484d63d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:18.745131 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-784a796a-f906-4ba8-be93-00eeb484d63d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1318 microversion: 2.1 time: 0.181146 Aug 26 09:01:18.745737 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 548/1088] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:18 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:19.768105 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-209ded9c-2809-4d73-b356-6dc8b00f5ec0 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:19.768817 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-209ded9c-2809-4d73-b356-6dc8b00f5ec0 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:19.776231 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-209ded9c-2809-4d73-b356-6dc8b00f5ec0 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:19.776770 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-209ded9c-2809-4d73-b356-6dc8b00f5ec0 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:19.777198 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-209ded9c-2809-4d73-b356-6dc8b00f5ec0 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:19.777900 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-209ded9c-2809-4d73-b356-6dc8b00f5ec0 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:19.778347 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-209ded9c-2809-4d73-b356-6dc8b00f5ec0 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:19.778767 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-209ded9c-2809-4d73-b356-6dc8b00f5ec0 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:19.931730 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-209ded9c-2809-4d73-b356-6dc8b00f5ec0 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:19.942364 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-209ded9c-2809-4d73-b356-6dc8b00f5ec0 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1318 microversion: 2.1 time: 0.178396 Aug 26 09:01:19.943019 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 541/1089] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:19 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:20.965922 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1cb83eb1-4272-4fe8-bedb-b1090779ce52 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:20.966656 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1cb83eb1-4272-4fe8-bedb-b1090779ce52 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:20.969141 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:20.969786 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=6 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:20.970610 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:20.976708 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1cb83eb1-4272-4fe8-bedb-b1090779ce52 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:20.977193 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1cb83eb1-4272-4fe8-bedb-b1090779ce52 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:20.977642 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1cb83eb1-4272-4fe8-bedb-b1090779ce52 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:20.978333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1cb83eb1-4272-4fe8-bedb-b1090779ce52 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:20.978782 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1cb83eb1-4272-4fe8-bedb-b1090779ce52 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:20.979262 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1cb83eb1-4272-4fe8-bedb-b1090779ce52 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:20.982575 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=59 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:21.127528 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1cb83eb1-4272-4fe8-bedb-b1090779ce52 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:21.136275 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1cb83eb1-4272-4fe8-bedb-b1090779ce52 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1318 microversion: 2.1 time: 0.174304 Aug 26 09:01:21.136835 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 549/1090] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:20 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:21.590598 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-1c5ffb29-1c7c-443d-9829-a01489ccf229 req-1c42c146-9213-46e7-8dac-c801dbabe5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e87910c-37ab-43c9-b76d-957282257a15", "name": "network-vif-plugged", "status": "completed", "tag": "6b259d13-3e81-43ea-89d3-6f544e3628b0"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:01:21.597743 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:21.599405 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:21.605399 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-1c5ffb29-1c7c-443d-9829-a01489ccf229 req-1c42c146-9213-46e7-8dac-c801dbabe5f3 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:21.605796 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-1c5ffb29-1c7c-443d-9829-a01489ccf229 req-1c42c146-9213-46e7-8dac-c801dbabe5f3 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:21.606231 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-1c5ffb29-1c7c-443d-9829-a01489ccf229 req-1c42c146-9213-46e7-8dac-c801dbabe5f3 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:21.610490 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:21.624520 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-1c5ffb29-1c7c-443d-9829-a01489ccf229 req-1c42c146-9213-46e7-8dac-c801dbabe5f3 service nova] Creating event network-vif-plugged:6b259d13-3e81-43ea-89d3-6f544e3628b0 for instance 3e87910c-37ab-43c9-b76d-957282257a15 on hv-cinder-85236 Aug 26 09:01:21.631823 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-1c5ffb29-1c7c-443d-9829-a01489ccf229 req-1c42c146-9213-46e7-8dac-c801dbabe5f3 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045646 Aug 26 09:01:21.633077 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 542/1091] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 09:01:22.157508 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8122500b-1495-45fb-8518-dbfc567107bc tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:22.158480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8122500b-1495-45fb-8518-dbfc567107bc tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:22.165121 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8122500b-1495-45fb-8518-dbfc567107bc tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:22.165644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8122500b-1495-45fb-8518-dbfc567107bc tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:22.166042 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8122500b-1495-45fb-8518-dbfc567107bc tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:22.166755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8122500b-1495-45fb-8518-dbfc567107bc tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:22.167235 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8122500b-1495-45fb-8518-dbfc567107bc tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:22.167646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8122500b-1495-45fb-8518-dbfc567107bc tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:22.350514 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8122500b-1495-45fb-8518-dbfc567107bc tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:22.363342 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8122500b-1495-45fb-8518-dbfc567107bc tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1318 microversion: 2.1 time: 0.209671 Aug 26 09:01:22.364126 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 550/1092] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:22 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:22.796620 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-43de5233-19a7-4b7e-8bc3-844597b5e120 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:22.797350 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-43de5233-19a7-4b7e-8bc3-844597b5e120 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:22.805097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-43de5233-19a7-4b7e-8bc3-844597b5e120 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:22.805584 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-43de5233-19a7-4b7e-8bc3-844597b5e120 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:22.806018 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-43de5233-19a7-4b7e-8bc3-844597b5e120 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:22.806738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-43de5233-19a7-4b7e-8bc3-844597b5e120 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:22.807217 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-43de5233-19a7-4b7e-8bc3-844597b5e120 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:22.807637 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-43de5233-19a7-4b7e-8bc3-844597b5e120 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:22.918835 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-43de5233-19a7-4b7e-8bc3-844597b5e120 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lazy-loading 'services' on Instance uuid da2a1535-5e7f-4273-92e8-000a88c5f734 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 09:01:23.008451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-43de5233-19a7-4b7e-8bc3-844597b5e120 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734/os-volume_attachments/8abf2f0c-b811-40c5-867d-37837a9af362" status: 202 len: 0 microversion: 2.1 time: 0.217296 Aug 26 09:01:23.009048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 543/1093] 10.222.0.71 () {58 vars in 1416 bytes} [Fri Aug 26 09:01:22 2022] DELETE /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734/os-volume_attachments/8abf2f0c-b811-40c5-867d-37837a9af362 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 09:01:23.017784 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c76b2f8e-b841-45ca-bdc5-587759cc335b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:23.020556 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c76b2f8e-b841-45ca-bdc5-587759cc335b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:23.029507 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c76b2f8e-b841-45ca-bdc5-587759cc335b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:23.030071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c76b2f8e-b841-45ca-bdc5-587759cc335b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:23.030654 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c76b2f8e-b841-45ca-bdc5-587759cc335b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:23.031755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c76b2f8e-b841-45ca-bdc5-587759cc335b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:23.032649 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c76b2f8e-b841-45ca-bdc5-587759cc335b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:23.033101 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c76b2f8e-b841-45ca-bdc5-587759cc335b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:23.066548 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c76b2f8e-b841-45ca-bdc5-587759cc335b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052845 Aug 26 09:01:23.067467 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 551/1094] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 09:01:23 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:01:23.393282 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-df1bf099-b291-4ffe-8645-274f41f9c78f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:23.394071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-df1bf099-b291-4ffe-8645-274f41f9c78f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:23.401384 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-df1bf099-b291-4ffe-8645-274f41f9c78f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:23.401780 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-df1bf099-b291-4ffe-8645-274f41f9c78f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:23.402215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-df1bf099-b291-4ffe-8645-274f41f9c78f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:23.403031 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-df1bf099-b291-4ffe-8645-274f41f9c78f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:23.403489 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-df1bf099-b291-4ffe-8645-274f41f9c78f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:23.403910 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-df1bf099-b291-4ffe-8645-274f41f9c78f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:23.601324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-df1bf099-b291-4ffe-8645-274f41f9c78f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:23.612163 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-df1bf099-b291-4ffe-8645-274f41f9c78f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1318 microversion: 2.1 time: 0.224086 Aug 26 09:01:23.612775 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 544/1095] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:23 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:24.080301 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f5c18e53-c6c2-4b22-b8c0-c5cbb68efa1b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:24.082760 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f5c18e53-c6c2-4b22-b8c0-c5cbb68efa1b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:24.089832 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f5c18e53-c6c2-4b22-b8c0-c5cbb68efa1b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:24.090311 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f5c18e53-c6c2-4b22-b8c0-c5cbb68efa1b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:24.090898 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f5c18e53-c6c2-4b22-b8c0-c5cbb68efa1b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:24.091485 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f5c18e53-c6c2-4b22-b8c0-c5cbb68efa1b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:24.091932 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f5c18e53-c6c2-4b22-b8c0-c5cbb68efa1b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:24.092377 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f5c18e53-c6c2-4b22-b8c0-c5cbb68efa1b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:24.126295 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f5c18e53-c6c2-4b22-b8c0-c5cbb68efa1b tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050363 Aug 26 09:01:24.127035 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 552/1096] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 09:01:24 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:01:24.633757 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e3b73b31-ddd1-4795-a866-891abb8eca7b tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:24.634349 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e3b73b31-ddd1-4795-a866-891abb8eca7b tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:24.641119 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e3b73b31-ddd1-4795-a866-891abb8eca7b tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:24.642523 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e3b73b31-ddd1-4795-a866-891abb8eca7b tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:24.642523 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e3b73b31-ddd1-4795-a866-891abb8eca7b tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:24.642811 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e3b73b31-ddd1-4795-a866-891abb8eca7b tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:24.643367 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e3b73b31-ddd1-4795-a866-891abb8eca7b tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:24.643780 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e3b73b31-ddd1-4795-a866-891abb8eca7b tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:24.794040 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e3b73b31-ddd1-4795-a866-891abb8eca7b tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:24.813517 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e3b73b31-ddd1-4795-a866-891abb8eca7b tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1507 microversion: 2.1 time: 0.183843 Aug 26 09:01:24.814080 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 545/1097] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:24 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:25.140096 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-7b4a233d-787c-489a-8bdb-775367f99e33 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:25.142546 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-7b4a233d-787c-489a-8bdb-775367f99e33 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:25.150321 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b4a233d-787c-489a-8bdb-775367f99e33 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:25.150670 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b4a233d-787c-489a-8bdb-775367f99e33 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:25.151195 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b4a233d-787c-489a-8bdb-775367f99e33 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:25.152026 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b4a233d-787c-489a-8bdb-775367f99e33 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:25.152678 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b4a233d-787c-489a-8bdb-775367f99e33 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:25.153310 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-7b4a233d-787c-489a-8bdb-775367f99e33 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:25.188968 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-7b4a233d-787c-489a-8bdb-775367f99e33 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053275 Aug 26 09:01:25.189574 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 553/1098] 10.222.0.71 () {58 vars in 1302 bytes} [Fri Aug 26 09:01:25 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 09:01:25.266207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-56af425f-8f20-4b0c-825a-cdf397080738 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:25.266704 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-56af425f-8f20-4b0c-825a-cdf397080738 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:25.275098 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-56af425f-8f20-4b0c-825a-cdf397080738 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:25.275836 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-56af425f-8f20-4b0c-825a-cdf397080738 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:25.276580 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-56af425f-8f20-4b0c-825a-cdf397080738 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:25.277596 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-56af425f-8f20-4b0c-825a-cdf397080738 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:25.278260 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-56af425f-8f20-4b0c-825a-cdf397080738 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:25.278830 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-56af425f-8f20-4b0c-825a-cdf397080738 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:25.318740 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-56af425f-8f20-4b0c-825a-cdf397080738 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 09:01:25.427555 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-56af425f-8f20-4b0c-825a-cdf397080738 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 204 len: 0 microversion: 2.1 time: 0.165517 Aug 26 09:01:25.429917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 546/1099] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 09:01:25 2022] DELETE /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 09:01:25.439262 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4d363f67-b6ba-435b-9b2c-d22c3de0cadd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:25.439729 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4d363f67-b6ba-435b-9b2c-d22c3de0cadd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:25.448750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d363f67-b6ba-435b-9b2c-d22c3de0cadd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:25.449509 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d363f67-b6ba-435b-9b2c-d22c3de0cadd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:25.449962 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d363f67-b6ba-435b-9b2c-d22c3de0cadd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:25.450662 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d363f67-b6ba-435b-9b2c-d22c3de0cadd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:25.451207 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d363f67-b6ba-435b-9b2c-d22c3de0cadd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:25.451619 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4d363f67-b6ba-435b-9b2c-d22c3de0cadd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:25.656334 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-4d363f67-b6ba-435b-9b2c-d22c3de0cadd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:25.664642 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4d363f67-b6ba-435b-9b2c-d22c3de0cadd tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1680 microversion: 2.1 time: 0.230168 Aug 26 09:01:25.675904 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 554/1100] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:25 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:26.689373 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-76fe6b98-c1f6-4eb7-9fed-40c8d9a08a4c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:26.690127 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-76fe6b98-c1f6-4eb7-9fed-40c8d9a08a4c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:26.696891 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-76fe6b98-c1f6-4eb7-9fed-40c8d9a08a4c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:26.697423 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-76fe6b98-c1f6-4eb7-9fed-40c8d9a08a4c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:26.697859 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-76fe6b98-c1f6-4eb7-9fed-40c8d9a08a4c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:26.698567 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-76fe6b98-c1f6-4eb7-9fed-40c8d9a08a4c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:26.699057 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-76fe6b98-c1f6-4eb7-9fed-40c8d9a08a4c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:26.699664 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-76fe6b98-c1f6-4eb7-9fed-40c8d9a08a4c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:26.900989 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-76fe6b98-c1f6-4eb7-9fed-40c8d9a08a4c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:26.911183 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-76fe6b98-c1f6-4eb7-9fed-40c8d9a08a4c tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1680 microversion: 2.1 time: 0.225739 Aug 26 09:01:26.914931 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 547/1101] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:26 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1680 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:27.024561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2084024888", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-484925391", "security_groups": [{"name": "tempest-secgroup-smoke-664018262"}], "block_device_mapping_v2": [{"uuid": "f97d772e-435e-4ad3-96c2-b9e2c8e12512", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f3820959-3ded-44b4-b94f-e8c3d94acf11"}]}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:01:27.154996 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.network.neutron [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] validate_networks() for [('f3820959-3ded-44b4-b94f-e8c3d94acf11', None, None, None, None, None)] {{(pid=132217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 09:01:27.601377 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Flavor limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 09:01:27.601792 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Image limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 09:01:27.602333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Flavor pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 09:01:27.602647 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Image pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 09:01:27.603086 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 09:01:27.612490 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:27.612965 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:27.613394 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:27.614106 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:27.614543 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:27.615158 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:27.643074 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Getting quotas for project 6773ba16da8845d39c90a627802cf05f. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 09:01:27.651645 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Getting quotas for user 34eaab912a91496daeedbaf63f5ddcbb and project 6773ba16da8845d39c90a627802cf05f. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 09:01:27.736320 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Going to run 1 instances... {{(pid=132217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 09:01:27.738524 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f97d772e-435e-4ad3-96c2-b9e2c8e12512',volume_size=None,volume_type=None)] {{(pid=132217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 09:01:27.895887 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-03411674-b346-49cb-b2ed-470e427a0774 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.875196 Aug 26 09:01:27.896905 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 555/1102] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 09:01:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 09:01:27.913697 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-08afeac2-2296-43e9-8eeb-e776fd3435b1 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:27.915163 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-08afeac2-2296-43e9-8eeb-e776fd3435b1 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:27.937411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1a81971a-5c0a-42ff-9a16-05af489f9ec9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:27.937411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1a81971a-5c0a-42ff-9a16-05af489f9ec9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:27.947854 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a81971a-5c0a-42ff-9a16-05af489f9ec9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:27.947854 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a81971a-5c0a-42ff-9a16-05af489f9ec9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:27.948666 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a81971a-5c0a-42ff-9a16-05af489f9ec9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:27.949560 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a81971a-5c0a-42ff-9a16-05af489f9ec9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:27.950013 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a81971a-5c0a-42ff-9a16-05af489f9ec9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:27.950499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1a81971a-5c0a-42ff-9a16-05af489f9ec9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:28.051121 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-08afeac2-2296-43e9-8eeb-e776fd3435b1 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:28.061401 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-08afeac2-2296-43e9-8eeb-e776fd3435b1 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1094 microversion: 2.1 time: 0.156465 Aug 26 09:01:28.062700 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 548/1103] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:27 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1094 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:28.149848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1a81971a-5c0a-42ff-9a16-05af489f9ec9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:28.160591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1a81971a-5c0a-42ff-9a16-05af489f9ec9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1680 microversion: 2.1 time: 0.229220 Aug 26 09:01:28.161788 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 556/1104] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:27 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:29.089089 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-cd003df5-cb78-4437-87f2-11f30a044f9a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:29.090395 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-cd003df5-cb78-4437-87f2-11f30a044f9a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:29.099983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd003df5-cb78-4437-87f2-11f30a044f9a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:29.100770 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd003df5-cb78-4437-87f2-11f30a044f9a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:29.101429 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd003df5-cb78-4437-87f2-11f30a044f9a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:29.102425 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd003df5-cb78-4437-87f2-11f30a044f9a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:29.103183 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd003df5-cb78-4437-87f2-11f30a044f9a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:29.103887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd003df5-cb78-4437-87f2-11f30a044f9a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:29.162511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-dd19860e-1e28-4f74-82f8-648b66455f30 req-7be039cb-5d5c-479c-93f4-1a09057e42cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da2a1535-5e7f-4273-92e8-000a88c5f734", "name": "network-vif-deleted", "tag": "c41998fb-0115-456d-88ef-ace4792ba96c"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:01:29.181261 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-dd19860e-1e28-4f74-82f8-648b66455f30 req-7be039cb-5d5c-479c-93f4-1a09057e42cd service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:29.182246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-dd19860e-1e28-4f74-82f8-648b66455f30 req-7be039cb-5d5c-479c-93f4-1a09057e42cd service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:29.183005 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-dd19860e-1e28-4f74-82f8-648b66455f30 req-7be039cb-5d5c-479c-93f4-1a09057e42cd service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:29.198563 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-dd19860e-1e28-4f74-82f8-648b66455f30 req-7be039cb-5d5c-479c-93f4-1a09057e42cd service nova] Creating event network-vif-deleted:c41998fb-0115-456d-88ef-ace4792ba96c for instance da2a1535-5e7f-4273-92e8-000a88c5f734 on hv-cinder-85236 Aug 26 09:01:29.205253 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-dd19860e-1e28-4f74-82f8-648b66455f30 req-7be039cb-5d5c-479c-93f4-1a09057e42cd service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047365 Aug 26 09:01:29.206967 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 557/1105] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:01:29.213984 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c4b56345-e14d-48eb-ba89-464c635cf285 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:29.215174 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c4b56345-e14d-48eb-ba89-464c635cf285 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:29.225497 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c4b56345-e14d-48eb-ba89-464c635cf285 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:29.226809 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c4b56345-e14d-48eb-ba89-464c635cf285 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:29.227765 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c4b56345-e14d-48eb-ba89-464c635cf285 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:29.228852 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c4b56345-e14d-48eb-ba89-464c635cf285 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:29.229777 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c4b56345-e14d-48eb-ba89-464c635cf285 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:29.230640 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c4b56345-e14d-48eb-ba89-464c635cf285 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:29.448835 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c4b56345-e14d-48eb-ba89-464c635cf285 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406be06d6adf40bbb48d9baf12022988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87dce6d7f01455fb8c3cfe128c20e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:29.464277 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c4b56345-e14d-48eb-ba89-464c635cf285 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 200 len: 1612 microversion: 2.1 time: 0.255566 Aug 26 09:01:29.467984 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 558/1106] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:29 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 1612 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:29.741237 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-cd003df5-cb78-4437-87f2-11f30a044f9a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:29.757407 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-cd003df5-cb78-4437-87f2-11f30a044f9a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1192 microversion: 2.1 time: 0.676594 Aug 26 09:01:29.773623 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 549/1107] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:29 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1192 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:30.490940 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6b1fe8ee-244a-40c8-af54-9cff08384ed3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:30.491559 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6b1fe8ee-244a-40c8-af54-9cff08384ed3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:30.505163 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b1fe8ee-244a-40c8-af54-9cff08384ed3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:30.506321 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b1fe8ee-244a-40c8-af54-9cff08384ed3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:30.507668 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b1fe8ee-244a-40c8-af54-9cff08384ed3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:30.508825 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b1fe8ee-244a-40c8-af54-9cff08384ed3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:30.509700 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b1fe8ee-244a-40c8-af54-9cff08384ed3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:30.510304 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6b1fe8ee-244a-40c8-af54-9cff08384ed3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:30.561879 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-6b1fe8ee-244a-40c8-af54-9cff08384ed3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] HTTP exception thrown: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6b1fe8ee-244a-40c8-af54-9cff08384ed3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Request method failure captured: Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 HTTP/1.1 Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIoEmQS0ltyE06Nj4PuDW7tRWlQx7ddVxbpmBorGEN4vH-Qi6t2BygustSi6IBEkokqI2I_SWwZYOmA6m8lhi8TWDRbttWpAHlEIqCkO0TFDD5IrIzdgnbzjwj6reGrNhrygHKk-ixwJbs_wRUzJRPtDT1VapHI831oEiCSS5Q537B4 Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:01:30.563762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:01:30.565423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f87dce6d7f01455fb8c3cfe128c20e72", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:30.565423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:30.565423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:30.565423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:30.565423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:30.565423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:01:30.565423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:01:30.565423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 406be06d6adf40bbb48d9baf12022988 Aug 26 09:01:30.565423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:30.565423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:01:30.565423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:30.565423 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': 'da2a1535-5e7f-4273-92e8-000a88c5f734'} Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:30.566241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:30.567623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:30.568894 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6b1fe8ee-244a-40c8-af54-9cff08384ed3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Returning 404 to user: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:30.568894 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6b1fe8ee-244a-40c8-af54-9cff08384ed3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 404 len: 111 microversion: 2.1 time: 0.078506 Aug 26 09:01:30.568894 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 559/1108] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:30 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:01:30.583151 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c6784fb4-5693-4fc6-aa87-2f89901c3082 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '.version_select at 0x7f136ce6fdc0>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:30.632011 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c6784fb4-5693-4fc6-aa87-2f89901c3082 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1710083053" status: 202 len: 0 microversion: 2.1 time: 0.057784 Aug 26 09:01:30.632640 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 550/1109] 10.222.0.71 () {58 vars in 1221 bytes} [Fri Aug 26 09:01:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1710083053 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 09:01:30.786129 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9a6e00e9-d932-47a8-930d-b38452f6bd1f tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:30.786748 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9a6e00e9-d932-47a8-930d-b38452f6bd1f tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:30.796130 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a6e00e9-d932-47a8-930d-b38452f6bd1f tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:30.797755 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a6e00e9-d932-47a8-930d-b38452f6bd1f tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:30.798386 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a6e00e9-d932-47a8-930d-b38452f6bd1f tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:30.801895 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a6e00e9-d932-47a8-930d-b38452f6bd1f tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:30.802516 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a6e00e9-d932-47a8-930d-b38452f6bd1f tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:30.803255 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-9a6e00e9-d932-47a8-930d-b38452f6bd1f tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:30.952621 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9a6e00e9-d932-47a8-930d-b38452f6bd1f tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:30.967137 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9a6e00e9-d932-47a8-930d-b38452f6bd1f tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1198 microversion: 2.1 time: 0.184896 Aug 26 09:01:30.983067 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 560/1110] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:30 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1198 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:31.997391 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2bcce7f6-408a-4f39-aead-749b5ffdb21b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:31.998008 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2bcce7f6-408a-4f39-aead-749b5ffdb21b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:32.006315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2bcce7f6-408a-4f39-aead-749b5ffdb21b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:32.006808 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2bcce7f6-408a-4f39-aead-749b5ffdb21b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:32.007310 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2bcce7f6-408a-4f39-aead-749b5ffdb21b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:32.008054 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2bcce7f6-408a-4f39-aead-749b5ffdb21b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:32.008485 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2bcce7f6-408a-4f39-aead-749b5ffdb21b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:32.008910 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2bcce7f6-408a-4f39-aead-749b5ffdb21b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:32.367507 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-7fcf2ed8-3d8d-4aa0-a965-7834566b9449 req-32eb05e2-e722-4cb2-a7d3-39f23874ed41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de326118-88c5-4143-ba33-ec222ab9a374", "tag": "4f8cb1f4-9a9e-4789-ab3a-fe22f32e08ea"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:01:32.392468 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-7fcf2ed8-3d8d-4aa0-a965-7834566b9449 req-32eb05e2-e722-4cb2-a7d3-39f23874ed41 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:32.394811 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-7fcf2ed8-3d8d-4aa0-a965-7834566b9449 req-32eb05e2-e722-4cb2-a7d3-39f23874ed41 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:32.396857 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-7fcf2ed8-3d8d-4aa0-a965-7834566b9449 req-32eb05e2-e722-4cb2-a7d3-39f23874ed41 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:32.409891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-7fcf2ed8-3d8d-4aa0-a965-7834566b9449 req-32eb05e2-e722-4cb2-a7d3-39f23874ed41 service nova] Creating event network-changed:4f8cb1f4-9a9e-4789-ab3a-fe22f32e08ea for instance de326118-88c5-4143-ba33-ec222ab9a374 on hv-cinder-85236 Aug 26 09:01:32.415803 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-7fcf2ed8-3d8d-4aa0-a965-7834566b9449 req-32eb05e2-e722-4cb2-a7d3-39f23874ed41 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054639 Aug 26 09:01:32.416986 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 561/1111] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:01:32.660578 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2bcce7f6-408a-4f39-aead-749b5ffdb21b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:32.672725 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2bcce7f6-408a-4f39-aead-749b5ffdb21b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1265 microversion: 2.1 time: 0.683159 Aug 26 09:01:32.673349 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 551/1112] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:31 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1265 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:33.023622 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-eb81b238-d7e6-4e9f-abf5-ed909b539a29 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:33.024425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-eb81b238-d7e6-4e9f-abf5-ed909b539a29 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:33.031352 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eb81b238-d7e6-4e9f-abf5-ed909b539a29 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:33.031996 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eb81b238-d7e6-4e9f-abf5-ed909b539a29 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:33.032536 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eb81b238-d7e6-4e9f-abf5-ed909b539a29 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:33.033352 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eb81b238-d7e6-4e9f-abf5-ed909b539a29 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:33.033939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eb81b238-d7e6-4e9f-abf5-ed909b539a29 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:33.034452 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-eb81b238-d7e6-4e9f-abf5-ed909b539a29 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:33.049041 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-eb81b238-d7e6-4e9f-abf5-ed909b539a29 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] HTTP exception thrown: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-eb81b238-d7e6-4e9f-abf5-ed909b539a29 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Request method failure captured: Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: DELETE /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 HTTP/1.1 Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIoEmQS0ltyE06Nj4PuDW7tRWlQx7ddVxbpmBorGEN4vH-Qi6t2BygustSi6IBEkokqI2I_SWwZYOmA6m8lhi8TWDRbttWpAHlEIqCkO0TFDD5IrIzdgnbzjwj6reGrNhrygHKk-ixwJbs_wRUzJRPtDT1VapHI831oEiCSS5Q537B4 Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:01:33.050578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:01:33.052203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f87dce6d7f01455fb8c3cfe128c20e72", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:33.052203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:33.052203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:33.052203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:33.052203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:33.052203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:01:33.052203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:01:33.052203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 406be06d6adf40bbb48d9baf12022988 Aug 26 09:01:33.052203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:33.052203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:01:33.052203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:33.052203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': 'da2a1535-5e7f-4273-92e8-000a88c5f734'} Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:33.053544 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:33.055426 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:33.057729 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-eb81b238-d7e6-4e9f-abf5-ed909b539a29 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Returning 404 to user: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:33.057729 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-eb81b238-d7e6-4e9f-abf5-ed909b539a29 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 404 len: 111 microversion: 2.1 time: 0.034377 Aug 26 09:01:33.057729 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 562/1113] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 09:01:33 2022] DELETE /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:01:33.061644 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-49e4fa93-3703-4535-ba89-a75ce012d330 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:33.063446 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-49e4fa93-3703-4535-ba89-a75ce012d330 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: da2a1535-5e7f-4273-92e8-000a88c5f734] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:33.070233 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-49e4fa93-3703-4535-ba89-a75ce012d330 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:33.070795 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-49e4fa93-3703-4535-ba89-a75ce012d330 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:33.071243 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-49e4fa93-3703-4535-ba89-a75ce012d330 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:33.072201 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-49e4fa93-3703-4535-ba89-a75ce012d330 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:33.072617 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-49e4fa93-3703-4535-ba89-a75ce012d330 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:33.073271 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-49e4fa93-3703-4535-ba89-a75ce012d330 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:33.089840 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-49e4fa93-3703-4535-ba89-a75ce012d330 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] HTTP exception thrown: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-49e4fa93-3703-4535-ba89-a75ce012d330 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Request method failure captured: Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 HTTP/1.1 Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCIoEmQS0ltyE06Nj4PuDW7tRWlQx7ddVxbpmBorGEN4vH-Qi6t2BygustSi6IBEkokqI2I_SWwZYOmA6m8lhi8TWDRbttWpAHlEIqCkO0TFDD5IrIzdgnbzjwj6reGrNhrygHKk-ixwJbs_wRUzJRPtDT1VapHI831oEiCSS5Q537B4 Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 09:01:33.091530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 09:01:33.093315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f87dce6d7f01455fb8c3cfe128c20e72", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:33.093315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:33.093315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:33.093315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:33.093315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:33.093315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 09:01:33.093315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 09:01:33.093315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 406be06d6adf40bbb48d9baf12022988 Aug 26 09:01:33.093315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:33.093315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 09:01:33.093315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:33.093315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': 'da2a1535-5e7f-4273-92e8-000a88c5f734'} Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:33.094166 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. Aug 26 09:01:33.095696 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:33.097238 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-49e4fa93-3703-4535-ba89-a75ce012d330 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Returning 404 to user: Instance da2a1535-5e7f-4273-92e8-000a88c5f734 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:33.097238 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-49e4fa93-3703-4535-ba89-a75ce012d330 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734" status: 404 len: 111 microversion: 2.1 time: 0.035634 Aug 26 09:01:33.097238 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 552/1114] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:33 2022] GET /compute/v2.1/servers/da2a1535-5e7f-4273-92e8-000a88c5f734 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:01:33.700220 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f3db4851-b594-4378-99ee-01019fcf08e1 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:33.701022 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f3db4851-b594-4378-99ee-01019fcf08e1 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:33.709471 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f3db4851-b594-4378-99ee-01019fcf08e1 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:33.710049 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f3db4851-b594-4378-99ee-01019fcf08e1 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:33.710684 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f3db4851-b594-4378-99ee-01019fcf08e1 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:33.711997 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f3db4851-b594-4378-99ee-01019fcf08e1 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:33.712640 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f3db4851-b594-4378-99ee-01019fcf08e1 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:33.713221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f3db4851-b594-4378-99ee-01019fcf08e1 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:34.122173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f3db4851-b594-4378-99ee-01019fcf08e1 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:34.131402 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f3db4851-b594-4378-99ee-01019fcf08e1 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1265 microversion: 2.1 time: 0.434516 Aug 26 09:01:34.132002 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 563/1115] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:33 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1265 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:34.288068 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ba1fb524-32ca-4b4f-b814-073e20fdb3a3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:34.289154 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ba1fb524-32ca-4b4f-b814-073e20fdb3a3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:34.298634 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba1fb524-32ca-4b4f-b814-073e20fdb3a3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:34.299183 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba1fb524-32ca-4b4f-b814-073e20fdb3a3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:34.299715 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba1fb524-32ca-4b4f-b814-073e20fdb3a3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:34.300549 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba1fb524-32ca-4b4f-b814-073e20fdb3a3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:34.300997 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba1fb524-32ca-4b4f-b814-073e20fdb3a3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:34.301432 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba1fb524-32ca-4b4f-b814-073e20fdb3a3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:34.316761 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-ba1fb524-32ca-4b4f-b814-073e20fdb3a3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] HTTP exception thrown: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ba1fb524-32ca-4b4f-b814-073e20fdb3a3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Request method failure captured: Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: DELETE /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 HTTP/1.1 Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCIoEmQS0ltyE06Nj4PuDW7tRWlQx7ddVxbpmBorGEN4vH-Qi6t2BygustSi6IBEkokqI2I_SWwZYOmA6m8lhi8TWDRbttWpAHlEIqCkO0TFDD5IrIzdgnbzjwj6reGrNhrygHKk-ixwJbs_wRUzJRPtDT1VapHI831oEiCSS5Q537B4 Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 09:01:34.318765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 09:01:34.320964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f87dce6d7f01455fb8c3cfe128c20e72", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:34.320964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:34.320964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:34.320964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:34.320964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:34.320964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 09:01:34.320964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 09:01:34.320964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 406be06d6adf40bbb48d9baf12022988 Aug 26 09:01:34.320964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:34.320964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 09:01:34.320964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 09:01:34.320964 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': '0695da3e-654d-4b9d-be68-e195e539e831'} Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:34.322259 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 09:01:34.328561 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.330794 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ba1fb524-32ca-4b4f-b814-073e20fdb3a3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Returning 404 to user: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:34.330794 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ba1fb524-32ca-4b4f-b814-073e20fdb3a3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 404 len: 111 microversion: 2.1 time: 0.038252 Aug 26 09:01:34.330794 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 553/1116] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 09:01:34 2022] DELETE /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:01:34.336267 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4f6d734b-78a6-4faa-9d5d-30f859f3e61e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:34.336863 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4f6d734b-78a6-4faa-9d5d-30f859f3e61e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: 0695da3e-654d-4b9d-be68-e195e539e831] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:34.344258 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f6d734b-78a6-4faa-9d5d-30f859f3e61e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:34.345020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f6d734b-78a6-4faa-9d5d-30f859f3e61e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:34.345453 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f6d734b-78a6-4faa-9d5d-30f859f3e61e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:34.346297 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f6d734b-78a6-4faa-9d5d-30f859f3e61e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:34.348333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f6d734b-78a6-4faa-9d5d-30f859f3e61e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:34.348789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4f6d734b-78a6-4faa-9d5d-30f859f3e61e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:34.379359 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-4f6d734b-78a6-4faa-9d5d-30f859f3e61e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] HTTP exception thrown: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4f6d734b-78a6-4faa-9d5d-30f859f3e61e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Request method failure captured: Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 HTTP/1.1 Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIoEmQS0ltyE06Nj4PuDW7tRWlQx7ddVxbpmBorGEN4vH-Qi6t2BygustSi6IBEkokqI2I_SWwZYOmA6m8lhi8TWDRbttWpAHlEIqCkO0TFDD5IrIzdgnbzjwj6reGrNhrygHKk-ixwJbs_wRUzJRPtDT1VapHI831oEiCSS5Q537B4 Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:01:34.382115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:01:34.386188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f87dce6d7f01455fb8c3cfe128c20e72", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:34.386188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:34.386188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:34.386188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:34.386188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:34.386188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:01:34.386188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:01:34.386188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 406be06d6adf40bbb48d9baf12022988 Aug 26 09:01:34.386188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:34.386188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:01:34.386188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 09:01:34.386188 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '0695da3e-654d-4b9d-be68-e195e539e831'} Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:34.387646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. Aug 26 09:01:34.392568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.395666 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4f6d734b-78a6-4faa-9d5d-30f859f3e61e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Returning 404 to user: Instance 0695da3e-654d-4b9d-be68-e195e539e831 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:34.395666 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4f6d734b-78a6-4faa-9d5d-30f859f3e61e tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831" status: 404 len: 111 microversion: 2.1 time: 0.051726 Aug 26 09:01:34.395666 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 564/1117] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:34 2022] GET /compute/v2.1/servers/0695da3e-654d-4b9d-be68-e195e539e831 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:01:34.397467 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8f4b1594-2072-48dc-9245-0b6c488480c9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:34.398099 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8f4b1594-2072-48dc-9245-0b6c488480c9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:34.405410 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8f4b1594-2072-48dc-9245-0b6c488480c9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:34.405925 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8f4b1594-2072-48dc-9245-0b6c488480c9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:34.406373 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8f4b1594-2072-48dc-9245-0b6c488480c9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:34.407125 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8f4b1594-2072-48dc-9245-0b6c488480c9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:34.407564 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8f4b1594-2072-48dc-9245-0b6c488480c9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:34.407976 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8f4b1594-2072-48dc-9245-0b6c488480c9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:34.426358 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-8f4b1594-2072-48dc-9245-0b6c488480c9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] HTTP exception thrown: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8f4b1594-2072-48dc-9245-0b6c488480c9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Request method failure captured: Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: DELETE /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 HTTP/1.1 Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCIoEmQS0ltyE06Nj4PuDW7tRWlQx7ddVxbpmBorGEN4vH-Qi6t2BygustSi6IBEkokqI2I_SWwZYOmA6m8lhi8TWDRbttWpAHlEIqCkO0TFDD5IrIzdgnbzjwj6reGrNhrygHKk-ixwJbs_wRUzJRPtDT1VapHI831oEiCSS5Q537B4 Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 09:01:34.427974 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 09:01:34.429642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f87dce6d7f01455fb8c3cfe128c20e72", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:34.429642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:34.429642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:34.429642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:34.429642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:34.429642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 09:01:34.429642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 09:01:34.429642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 406be06d6adf40bbb48d9baf12022988 Aug 26 09:01:34.429642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:34.429642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 09:01:34.429642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 09:01:34.429642 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': 'b220de56-45f9-4761-8d48-e80cbc874ca2'} Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:34.431674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 09:01:34.433283 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.434819 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8f4b1594-2072-48dc-9245-0b6c488480c9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Returning 404 to user: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:34.434819 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8f4b1594-2072-48dc-9245-0b6c488480c9 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 404 len: 111 microversion: 2.1 time: 0.038079 Aug 26 09:01:34.434819 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 554/1118] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 09:01:34 2022] DELETE /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:01:34.440600 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-00f3d0f0-ece5-4f0e-a939-bcdcf7171f74 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:34.441615 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-00f3d0f0-ece5-4f0e-a939-bcdcf7171f74 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: b220de56-45f9-4761-8d48-e80cbc874ca2] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:34.453705 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00f3d0f0-ece5-4f0e-a939-bcdcf7171f74 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:34.454943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00f3d0f0-ece5-4f0e-a939-bcdcf7171f74 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:34.456097 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00f3d0f0-ece5-4f0e-a939-bcdcf7171f74 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:34.457956 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00f3d0f0-ece5-4f0e-a939-bcdcf7171f74 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:34.459207 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00f3d0f0-ece5-4f0e-a939-bcdcf7171f74 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:34.460218 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-00f3d0f0-ece5-4f0e-a939-bcdcf7171f74 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:34.479951 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-00f3d0f0-ece5-4f0e-a939-bcdcf7171f74 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] HTTP exception thrown: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-00f3d0f0-ece5-4f0e-a939-bcdcf7171f74 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Request method failure captured: Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 HTTP/1.1 Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIoEmQS0ltyE06Nj4PuDW7tRWlQx7ddVxbpmBorGEN4vH-Qi6t2BygustSi6IBEkokqI2I_SWwZYOmA6m8lhi8TWDRbttWpAHlEIqCkO0TFDD5IrIzdgnbzjwj6reGrNhrygHKk-ixwJbs_wRUzJRPtDT1VapHI831oEiCSS5Q537B4 Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:01:34.481555 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:01:34.483328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f87dce6d7f01455fb8c3cfe128c20e72", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:34.483328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:34.483328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:34.483328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:34.483328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:34.483328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:01:34.483328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:01:34.483328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 406be06d6adf40bbb48d9baf12022988 Aug 26 09:01:34.483328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:34.483328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:01:34.483328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 09:01:34.483328 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': 'b220de56-45f9-4761-8d48-e80cbc874ca2'} Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:34.484992 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. Aug 26 09:01:34.492410 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:34.494806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-00f3d0f0-ece5-4f0e-a939-bcdcf7171f74 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Returning 404 to user: Instance b220de56-45f9-4761-8d48-e80cbc874ca2 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:34.494806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-00f3d0f0-ece5-4f0e-a939-bcdcf7171f74 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2" status: 404 len: 111 microversion: 2.1 time: 0.048559 Aug 26 09:01:34.494806 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 565/1119] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:34 2022] GET /compute/v2.1/servers/b220de56-45f9-4761-8d48-e80cbc874ca2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:01:35.152786 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-42e76302-dc3a-474f-8a59-8c36e65834ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:35.153448 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-42e76302-dc3a-474f-8a59-8c36e65834ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:35.160334 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-42e76302-dc3a-474f-8a59-8c36e65834ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:35.160833 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-42e76302-dc3a-474f-8a59-8c36e65834ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:35.161268 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-42e76302-dc3a-474f-8a59-8c36e65834ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:35.161971 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-42e76302-dc3a-474f-8a59-8c36e65834ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:35.162476 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-42e76302-dc3a-474f-8a59-8c36e65834ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:35.162916 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-42e76302-dc3a-474f-8a59-8c36e65834ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:35.312437 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-42e76302-dc3a-474f-8a59-8c36e65834ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:35.322867 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-42e76302-dc3a-474f-8a59-8c36e65834ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1265 microversion: 2.1 time: 0.173651 Aug 26 09:01:35.323929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 555/1120] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:35 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:35.671156 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6273fff2-406f-4e24-b87f-5adde5f331b3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:35.671809 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6273fff2-406f-4e24-b87f-5adde5f331b3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:35.682173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6273fff2-406f-4e24-b87f-5adde5f331b3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:35.682842 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6273fff2-406f-4e24-b87f-5adde5f331b3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:35.683430 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6273fff2-406f-4e24-b87f-5adde5f331b3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:35.684667 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6273fff2-406f-4e24-b87f-5adde5f331b3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:35.685787 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6273fff2-406f-4e24-b87f-5adde5f331b3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:35.686488 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6273fff2-406f-4e24-b87f-5adde5f331b3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:35.708317 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-6273fff2-406f-4e24-b87f-5adde5f331b3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] HTTP exception thrown: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6273fff2-406f-4e24-b87f-5adde5f331b3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Request method failure captured: Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: DELETE /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 HTTP/1.1 Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIoEmQS0ltyE06Nj4PuDW7tRWlQx7ddVxbpmBorGEN4vH-Qi6t2BygustSi6IBEkokqI2I_SWwZYOmA6m8lhi8TWDRbttWpAHlEIqCkO0TFDD5IrIzdgnbzjwj6reGrNhrygHKk-ixwJbs_wRUzJRPtDT1VapHI831oEiCSS5Q537B4 Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:01:35.709870 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:01:35.712675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f87dce6d7f01455fb8c3cfe128c20e72", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:35.712675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:35.712675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:35.712675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:35.712675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:35.712675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:01:35.712675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:01:35.712675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 406be06d6adf40bbb48d9baf12022988 Aug 26 09:01:35.712675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:35.712675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:01:35.712675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 09:01:35.712675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': 'a2e441bb-c7f1-4f57-a936-ae82ddea56c5'} Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:35.714241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 09:01:35.717071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:35.723432 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6273fff2-406f-4e24-b87f-5adde5f331b3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Returning 404 to user: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:35.723432 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6273fff2-406f-4e24-b87f-5adde5f331b3 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "DELETE /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 404 len: 111 microversion: 2.1 time: 0.044425 Aug 26 09:01:35.723432 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 566/1121] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 09:01:35 2022] DELETE /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:01:35.730530 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4f629124-479e-472c-8909-b61e6d2cd8b1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:35.731404 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4f629124-479e-472c-8909-b61e6d2cd8b1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] [instance: a2e441bb-c7f1-4f57-a936-ae82ddea56c5] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:35.740038 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f629124-479e-472c-8909-b61e6d2cd8b1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:35.740839 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f629124-479e-472c-8909-b61e6d2cd8b1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:35.741529 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f629124-479e-472c-8909-b61e6d2cd8b1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:35.742675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f629124-479e-472c-8909-b61e6d2cd8b1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:35.743460 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f629124-479e-472c-8909-b61e6d2cd8b1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:35.744409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f629124-479e-472c-8909-b61e6d2cd8b1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:35.775483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-4f629124-479e-472c-8909-b61e6d2cd8b1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] HTTP exception thrown: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4f629124-479e-472c-8909-b61e6d2cd8b1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Request method failure captured: Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 HTTP/1.1 Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCIoEmQS0ltyE06Nj4PuDW7tRWlQx7ddVxbpmBorGEN4vH-Qi6t2BygustSi6IBEkokqI2I_SWwZYOmA6m8lhi8TWDRbttWpAHlEIqCkO0TFDD5IrIzdgnbzjwj6reGrNhrygHKk-ixwJbs_wRUzJRPtDT1VapHI831oEiCSS5Q537B4 Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 09:01:35.777629 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 09:01:35.782215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_f87dce6d7f01455fb8c3cfe128c20e72", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/f87dce6d7f01455fb8c3cfe128c20e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:35.782215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:35.782215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: f87dce6d7f01455fb8c3cfe128c20e72 Aug 26 09:01:35.782215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1149866851 Aug 26 09:01:35.782215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:35.782215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 09:01:35.782215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 09:01:35.782215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 406be06d6adf40bbb48d9baf12022988 Aug 26 09:01:35.782215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-AttachVolumeNegativeTest-1149866851-project Aug 26 09:01:35.782215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 09:01:35.782215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 09:01:35.782215 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': 'a2e441bb-c7f1-4f57-a936-ae82ddea56c5'} Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:35.783264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. Aug 26 09:01:35.784857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:35.786290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4f629124-479e-472c-8909-b61e6d2cd8b1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] Returning 404 to user: Instance a2e441bb-c7f1-4f57-a936-ae82ddea56c5 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:35.786290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4f629124-479e-472c-8909-b61e6d2cd8b1 tempest-AttachVolumeNegativeTest-1149866851 tempest-AttachVolumeNegativeTest-1149866851-project] 10.222.0.71 "GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5" status: 404 len: 111 microversion: 2.1 time: 0.059615 Aug 26 09:01:35.786290 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 556/1122] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:35 2022] GET /compute/v2.1/servers/a2e441bb-c7f1-4f57-a936-ae82ddea56c5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:01:36.347910 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a858269d-4300-49e9-bc91-de196f681326 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:36.348545 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a858269d-4300-49e9-bc91-de196f681326 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:36.378494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a858269d-4300-49e9-bc91-de196f681326 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:36.379577 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a858269d-4300-49e9-bc91-de196f681326 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:36.380308 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a858269d-4300-49e9-bc91-de196f681326 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:36.381664 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a858269d-4300-49e9-bc91-de196f681326 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:36.383098 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a858269d-4300-49e9-bc91-de196f681326 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:36.383720 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a858269d-4300-49e9-bc91-de196f681326 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:36.567264 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a858269d-4300-49e9-bc91-de196f681326 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:36.579592 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a858269d-4300-49e9-bc91-de196f681326 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1265 microversion: 2.1 time: 0.236754 Aug 26 09:01:36.587699 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 567/1123] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:36 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:37.601939 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-aa63d0c7-3539-4e7c-a306-a432e33ce2dc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:37.603137 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-aa63d0c7-3539-4e7c-a306-a432e33ce2dc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:37.610476 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa63d0c7-3539-4e7c-a306-a432e33ce2dc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:37.611083 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa63d0c7-3539-4e7c-a306-a432e33ce2dc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:37.611532 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa63d0c7-3539-4e7c-a306-a432e33ce2dc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:37.612417 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa63d0c7-3539-4e7c-a306-a432e33ce2dc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:37.612870 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa63d0c7-3539-4e7c-a306-a432e33ce2dc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:37.613417 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa63d0c7-3539-4e7c-a306-a432e33ce2dc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:38.061146 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:38.264978 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-aa63d0c7-3539-4e7c-a306-a432e33ce2dc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:38.291556 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-aa63d0c7-3539-4e7c-a306-a432e33ce2dc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1265 microversion: 2.1 time: 0.692681 Aug 26 09:01:38.292499 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 557/1124] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:37 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1265 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:39.317045 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-cac4283a-759d-423d-8d78-5169bc272259 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:39.319051 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-cac4283a-759d-423d-8d78-5169bc272259 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:39.323343 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:39.325485 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=6 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:39.338437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cac4283a-759d-423d-8d78-5169bc272259 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:39.339686 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cac4283a-759d-423d-8d78-5169bc272259 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:39.340687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cac4283a-759d-423d-8d78-5169bc272259 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:39.342106 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cac4283a-759d-423d-8d78-5169bc272259 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:39.343530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cac4283a-759d-423d-8d78-5169bc272259 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:39.344326 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-cac4283a-759d-423d-8d78-5169bc272259 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:39.558052 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-cac4283a-759d-423d-8d78-5169bc272259 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:39.588160 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-cac4283a-759d-423d-8d78-5169bc272259 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1265 microversion: 2.1 time: 0.275207 Aug 26 09:01:39.590563 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 568/1125] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:39 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:40.615385 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-321cc9ef-e036-4ab4-8990-5793fcfd7cb0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:40.616048 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-321cc9ef-e036-4ab4-8990-5793fcfd7cb0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:40.625391 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-321cc9ef-e036-4ab4-8990-5793fcfd7cb0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:40.626061 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-321cc9ef-e036-4ab4-8990-5793fcfd7cb0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:40.632921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-321cc9ef-e036-4ab4-8990-5793fcfd7cb0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:40.639309 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-321cc9ef-e036-4ab4-8990-5793fcfd7cb0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:40.639309 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-321cc9ef-e036-4ab4-8990-5793fcfd7cb0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:40.639309 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-321cc9ef-e036-4ab4-8990-5793fcfd7cb0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:40.894272 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-321cc9ef-e036-4ab4-8990-5793fcfd7cb0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:40.903768 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-321cc9ef-e036-4ab4-8990-5793fcfd7cb0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1265 microversion: 2.1 time: 0.291842 Aug 26 09:01:40.905597 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 558/1126] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:40 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:41.706623 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-b8a25394-991c-4610-a8dc-f0f9bf39663c req-d9b1b5d7-3cba-4481-acb6-0e3d91e0b4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de326118-88c5-4143-ba33-ec222ab9a374", "name": "network-vif-plugged", "status": "completed", "tag": "4f8cb1f4-9a9e-4789-ab3a-fe22f32e08ea"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:01:41.722823 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-b8a25394-991c-4610-a8dc-f0f9bf39663c req-d9b1b5d7-3cba-4481-acb6-0e3d91e0b4e6 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:41.723353 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-b8a25394-991c-4610-a8dc-f0f9bf39663c req-d9b1b5d7-3cba-4481-acb6-0e3d91e0b4e6 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:41.723777 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-b8a25394-991c-4610-a8dc-f0f9bf39663c req-d9b1b5d7-3cba-4481-acb6-0e3d91e0b4e6 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:41.739323 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-b8a25394-991c-4610-a8dc-f0f9bf39663c req-d9b1b5d7-3cba-4481-acb6-0e3d91e0b4e6 service nova] Creating event network-vif-plugged:4f8cb1f4-9a9e-4789-ab3a-fe22f32e08ea for instance de326118-88c5-4143-ba33-ec222ab9a374 on hv-cinder-85236 Aug 26 09:01:41.746141 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-b8a25394-991c-4610-a8dc-f0f9bf39663c req-d9b1b5d7-3cba-4481-acb6-0e3d91e0b4e6 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047904 Aug 26 09:01:41.746878 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 569/1127] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:01:41.929187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f33815be-9edb-4799-89e0-2dde0bbb9fec tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:41.930512 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f33815be-9edb-4799-89e0-2dde0bbb9fec tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:41.940948 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f33815be-9edb-4799-89e0-2dde0bbb9fec tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:41.941878 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f33815be-9edb-4799-89e0-2dde0bbb9fec tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:41.942628 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f33815be-9edb-4799-89e0-2dde0bbb9fec tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:41.944709 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f33815be-9edb-4799-89e0-2dde0bbb9fec tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:41.945492 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f33815be-9edb-4799-89e0-2dde0bbb9fec tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:41.945984 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f33815be-9edb-4799-89e0-2dde0bbb9fec tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:42.203497 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f33815be-9edb-4799-89e0-2dde0bbb9fec tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:42.214108 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f33815be-9edb-4799-89e0-2dde0bbb9fec tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1265 microversion: 2.1 time: 0.289796 Aug 26 09:01:42.215025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 559/1128] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:41 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:42.662045 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9307b868-abf7-4db1-98f8-cba866c4e93a tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Action: 'create', calling method: .version_select at 0x7f1367e6baf0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-926392702", "metadata": {"Type": "work"}}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9307b868-abf7-4db1-98f8-cba866c4e93a tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Request method failure captured: Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 121 Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIv2vcunjaI--hzmjy4b53tqbvfx2DnUsXGfisI4419S-7qMAgz59C7cfUFRiajwf9WeuFCiB5ryNvm2Uxj2dj3Q_rp-cPz7ZJBI_lipxeNfgCX0635btfPSbC2I_vobqOS3f-i1E8QyFNztWGBifIzpRwIVNbXBWXrBvS85Q562NXo Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 7ca97fa879a446cbbed3fd5133ac0ac2 Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:01:42.682016 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:01:42.684897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_7ca97fa879a446cbbed3fd5133ac0ac2", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:42.684897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.684897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 7ca97fa879a446cbbed3fd5133ac0ac2 Aug 26 09:01:42.684897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.684897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-VolumesNegativeTest-702241756-project Aug 26 09:01:42.684897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:01:42.684897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:01:42.684897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 10af5c7026dd4aaaafb93bc6ce6005ad Aug 26 09:01:42.684897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-VolumesNegativeTest-702241756-project Aug 26 09:01:42.684897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Aug 26 09:01:42.684897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-926392702", "metadata": {"Type": "work"}}} Aug 26 09:01:42.684897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: Aug 26 09:01:42.684897 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-926392702', 'metadata': {'Type': 'work'}}}} Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise error Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi '#$%' Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:42.686364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 09:01:42.688605 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 09:01:42.690590 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 09:01:42.690590 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.690590 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9307b868-abf7-4db1-98f8-cba866c4e93a tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:42.690590 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9307b868-abf7-4db1-98f8-cba866c4e93a tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.174341 Aug 26 09:01:42.690590 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 570/1129] 10.222.0.71 () {60 vars in 1156 bytes} [Fri Aug 26 09:01:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 09:01:42.695707 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e2205fe8-1a4a-41ed-85c0-a33e37c1c22c tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Action: 'create', calling method: .version_select at 0x7f136c1a7430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1792147603", "metadata": {"Type": "work"}}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e2205fe8-1a4a-41ed-85c0-a33e37c1c22c tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Request method failure captured: Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 120 Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCIv2vcunjaI--hzmjy4b53tqbvfx2DnUsXGfisI4419S-7qMAgz59C7cfUFRiajwf9WeuFCiB5ryNvm2Uxj2dj3Q_rp-cPz7ZJBI_lipxeNfgCX0635btfPSbC2I_vobqOS3f-i1E8QyFNztWGBifIzpRwIVNbXBWXrBvS85Q562NXo Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 7ca97fa879a446cbbed3fd5133ac0ac2 Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 09:01:42.700451 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 09:01:42.702483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_7ca97fa879a446cbbed3fd5133ac0ac2", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:42.702483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.702483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 7ca97fa879a446cbbed3fd5133ac0ac2 Aug 26 09:01:42.702483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.702483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-VolumesNegativeTest-702241756-project Aug 26 09:01:42.702483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 09:01:42.702483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 09:01:42.702483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 10af5c7026dd4aaaafb93bc6ce6005ad Aug 26 09:01:42.702483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-VolumesNegativeTest-702241756-project Aug 26 09:01:42.702483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Aug 26 09:01:42.702483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1792147603", "metadata": {"Type": "work"}}} Aug 26 09:01:42.702483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: Aug 26 09:01:42.702483 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1792147603', 'metadata': {'Type': 'work'}}}} Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise error Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi '0' Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:42.706069 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 09:01:42.707734 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 09:01:42.709246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 09:01:42.709246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.709246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e2205fe8-1a4a-41ed-85c0-a33e37c1c22c tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:42.709246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e2205fe8-1a4a-41ed-85c0-a33e37c1c22c tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011063 Aug 26 09:01:42.709246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 560/1130] 10.222.0.71 () {60 vars in 1156 bytes} [Fri Aug 26 09:01:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 26 09:01:42.713312 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-94838bb0-f62a-44a9-ac46-c1f657ba480b tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Action: 'create', calling method: .version_select at 0x7f1367e98a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-894898372", "metadata": {"Type": "work"}}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-94838bb0-f62a-44a9-ac46-c1f657ba480b tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Request method failure captured: Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 118 Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIv2vcunjaI--hzmjy4b53tqbvfx2DnUsXGfisI4419S-7qMAgz59C7cfUFRiajwf9WeuFCiB5ryNvm2Uxj2dj3Q_rp-cPz7ZJBI_lipxeNfgCX0635btfPSbC2I_vobqOS3f-i1E8QyFNztWGBifIzpRwIVNbXBWXrBvS85Q562NXo Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 7ca97fa879a446cbbed3fd5133ac0ac2 Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:01:42.716970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:01:42.718550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_7ca97fa879a446cbbed3fd5133ac0ac2", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:42.718550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.718550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 7ca97fa879a446cbbed3fd5133ac0ac2 Aug 26 09:01:42.718550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.718550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-VolumesNegativeTest-702241756-project Aug 26 09:01:42.718550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:01:42.718550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:01:42.718550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 10af5c7026dd4aaaafb93bc6ce6005ad Aug 26 09:01:42.718550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-VolumesNegativeTest-702241756-project Aug 26 09:01:42.718550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Aug 26 09:01:42.718550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-894898372", "metadata": {"Type": "work"}}} Aug 26 09:01:42.718550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: Aug 26 09:01:42.718550 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-894898372', 'metadata': {'Type': 'work'}}}} Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise error Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi '' Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:42.719591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 09:01:42.721382 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 09:01:42.724490 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 09:01:42.724490 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.724490 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-94838bb0-f62a-44a9-ac46-c1f657ba480b tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:42.724490 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-94838bb0-f62a-44a9-ac46-c1f657ba480b tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009692 Aug 26 09:01:42.724490 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 571/1131] 10.222.0.71 () {60 vars in 1156 bytes} [Fri Aug 26 09:01:42 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 09:01:42.730752 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-578de98f-7da9-4c7e-9514-15b9556ec7f1 tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Calling method '.version_select at 0x7f136c0890d0>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:42.770710 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-578de98f-7da9-4c7e-9514-15b9556ec7f1 tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] HTTP exception thrown: Volume tempest-invalid-882751870 could not be found. Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-578de98f-7da9-4c7e-9514-15b9556ec7f1 tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Request method failure captured: Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-882751870 HTTP/1.1 Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCIv2vcunjaI--hzmjy4b53tqbvfx2DnUsXGfisI4419S-7qMAgz59C7cfUFRiajwf9WeuFCiB5ryNvm2Uxj2dj3Q_rp-cPz7ZJBI_lipxeNfgCX0635btfPSbC2I_vobqOS3f-i1E8QyFNztWGBifIzpRwIVNbXBWXrBvS85Q562NXo Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 7ca97fa879a446cbbed3fd5133ac0ac2 Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 09:01:42.774719 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 09:01:42.777352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_7ca97fa879a446cbbed3fd5133ac0ac2", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:42.777352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.777352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 7ca97fa879a446cbbed3fd5133ac0ac2 Aug 26 09:01:42.777352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.777352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-VolumesNegativeTest-702241756-project Aug 26 09:01:42.777352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 09:01:42.777352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 09:01:42.777352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 10af5c7026dd4aaaafb93bc6ce6005ad Aug 26 09:01:42.777352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-VolumesNegativeTest-702241756-project Aug 26 09:01:42.777352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: Aug 26 09:01:42.777352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Volume tempest-invalid-882751870 could not be found. Aug 26 09:01:42.777352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': 'tempest-invalid-882751870'} Aug 26 09:01:42.777352 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-882751870 could not be found. (HTTP 404) (Request-ID: req-6a26f601-bd18-4395-b9f9-3ea50bd1c27e) Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.778784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 09:01:42.782832 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-882751870 could not be found. Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:01:42.785114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-882751870 could not be found. Aug 26 09:01:42.786409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.786409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.786409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.786409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.786409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:42.786409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:42.786409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:01:42.786409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:01:42.786409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-882751870 could not be found. Aug 26 09:01:42.786409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.786409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-578de98f-7da9-4c7e-9514-15b9556ec7f1 tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Returning 404 to user: Volume tempest-invalid-882751870 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:42.786409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-578de98f-7da9-4c7e-9514-15b9556ec7f1 tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/tempest-invalid-882751870" status: 404 len: 98 microversion: 2.1 time: 0.051121 Aug 26 09:01:42.786409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 561/1132] 10.222.0.71 () {58 vars in 1215 bytes} [Fri Aug 26 09:01:42 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-882751870 => generated 98 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 26 09:01:42.792118 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c355837e-368a-42f0-9018-5d240e1089f3 tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004755 Aug 26 09:01:42.792881 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 572/1133] 10.222.0.71 () {58 vars in 1140 bytes} [Fri Aug 26 09:01:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 26 09:01:42.802473 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e67730cf-cc6e-49f7-88c7-d3b8cdc5756e tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004099 Aug 26 09:01:42.803014 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 562/1134] 10.222.0.71 () {58 vars in 1137 bytes} [Fri Aug 26 09:01:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 26 09:01:42.814705 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-600abf98-a74c-48e7-becd-27628d4060e8 tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Calling method '.version_select at 0x7f136c393ca0>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:42.850688 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-600abf98-a74c-48e7-becd-27628d4060e8 tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] HTTP exception thrown: Volume 4ef32167-0d38-4708-b406-3f34e8f4cc70 could not be found. Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-600abf98-a74c-48e7-becd-27628d4060e8 tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Request method failure captured: Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: DELETE /compute/v2.1/os-volumes/4ef32167-0d38-4708-b406-3f34e8f4cc70 HTTP/1.1 Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIv2vcunjaI--hzmjy4b53tqbvfx2DnUsXGfisI4419S-7qMAgz59C7cfUFRiajwf9WeuFCiB5ryNvm2Uxj2dj3Q_rp-cPz7ZJBI_lipxeNfgCX0635btfPSbC2I_vobqOS3f-i1E8QyFNztWGBifIzpRwIVNbXBWXrBvS85Q562NXo Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 7ca97fa879a446cbbed3fd5133ac0ac2 Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:01:42.853231 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:01:42.856053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_7ca97fa879a446cbbed3fd5133ac0ac2", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:42.856053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.856053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 7ca97fa879a446cbbed3fd5133ac0ac2 Aug 26 09:01:42.856053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.856053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-VolumesNegativeTest-702241756-project Aug 26 09:01:42.856053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:01:42.856053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:01:42.856053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 10af5c7026dd4aaaafb93bc6ce6005ad Aug 26 09:01:42.856053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-VolumesNegativeTest-702241756-project Aug 26 09:01:42.856053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: Aug 26 09:01:42.856053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Volume 4ef32167-0d38-4708-b406-3f34e8f4cc70 could not be found. Aug 26 09:01:42.856053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '4ef32167-0d38-4708-b406-3f34e8f4cc70'} Aug 26 09:01:42.856053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ef32167-0d38-4708-b406-3f34e8f4cc70 could not be found. (HTTP 404) (Request-ID: req-a3e3ecf2-da22-4c47-91e1-3b4d3c605922) Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.858704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 09:01:42.860798 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ef32167-0d38-4708-b406-3f34e8f4cc70 could not be found. Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 09:01:42.864037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:01:42.866704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ef32167-0d38-4708-b406-3f34e8f4cc70 could not be found. Aug 26 09:01:42.866704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.866704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.866704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.866704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.866704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:42.866704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:42.866704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:01:42.866704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:01:42.866704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ef32167-0d38-4708-b406-3f34e8f4cc70 could not be found. Aug 26 09:01:42.866704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.866704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-600abf98-a74c-48e7-becd-27628d4060e8 tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Returning 404 to user: Volume 4ef32167-0d38-4708-b406-3f34e8f4cc70 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:42.866704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-600abf98-a74c-48e7-becd-27628d4060e8 tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/4ef32167-0d38-4708-b406-3f34e8f4cc70" status: 404 len: 109 microversion: 2.1 time: 0.045795 Aug 26 09:01:42.866704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 573/1135] 10.222.0.71 () {58 vars in 1248 bytes} [Fri Aug 26 09:01:42 2022] DELETE /compute/v2.1/os-volumes/4ef32167-0d38-4708-b406-3f34e8f4cc70 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:01:42.870872 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-120a2b48-7fe4-4870-aabc-85afb73bbedc tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Calling method '.version_select at 0x7f136c151280>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:42.914992 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-120a2b48-7fe4-4870-aabc-85afb73bbedc tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] HTTP exception thrown: Volume 12ed2997-b879-482f-b8d1-039cbc27bada could not be found. Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-120a2b48-7fe4-4870-aabc-85afb73bbedc tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Request method failure captured: Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: GET /compute/v2.1/os-volumes/12ed2997-b879-482f-b8d1-039cbc27bada HTTP/1.1 Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCIv2vcunjaI--hzmjy4b53tqbvfx2DnUsXGfisI4419S-7qMAgz59C7cfUFRiajwf9WeuFCiB5ryNvm2Uxj2dj3Q_rp-cPz7ZJBI_lipxeNfgCX0635btfPSbC2I_vobqOS3f-i1E8QyFNztWGBifIzpRwIVNbXBWXrBvS85Q562NXo Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 7ca97fa879a446cbbed3fd5133ac0ac2 Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 09:01:42.917658 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 09:01:42.921843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_7ca97fa879a446cbbed3fd5133ac0ac2", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/7ca97fa879a446cbbed3fd5133ac0ac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:01:42.921843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.921843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 7ca97fa879a446cbbed3fd5133ac0ac2 Aug 26 09:01:42.921843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-VolumesNegativeTest-702241756 Aug 26 09:01:42.921843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-VolumesNegativeTest-702241756-project Aug 26 09:01:42.921843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 09:01:42.921843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 09:01:42.921843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 10af5c7026dd4aaaafb93bc6ce6005ad Aug 26 09:01:42.921843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-VolumesNegativeTest-702241756-project Aug 26 09:01:42.921843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: Aug 26 09:01:42.921843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Volume 12ed2997-b879-482f-b8d1-039cbc27bada could not be found. Aug 26 09:01:42.921843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': '12ed2997-b879-482f-b8d1-039cbc27bada'} Aug 26 09:01:42.921843 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 12ed2997-b879-482f-b8d1-039cbc27bada could not be found. (HTTP 404) (Request-ID: req-f322977a-c8ca-48bc-9e14-d07fc3c471c3) Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.923983 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 09:01:42.927070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 12ed2997-b879-482f-b8d1-039cbc27bada could not be found. Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 09:01:42.930150 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:01:42.933104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 12ed2997-b879-482f-b8d1-039cbc27bada could not be found. Aug 26 09:01:42.933104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.933104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:01:42.933104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.933104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:01:42.933104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:01:42.933104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:01:42.933104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:01:42.933104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:01:42.933104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 12ed2997-b879-482f-b8d1-039cbc27bada could not be found. Aug 26 09:01:42.933104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:01:42.933104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-120a2b48-7fe4-4870-aabc-85afb73bbedc tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] Returning 404 to user: Volume 12ed2997-b879-482f-b8d1-039cbc27bada could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:01:42.933104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-120a2b48-7fe4-4870-aabc-85afb73bbedc tempest-VolumesNegativeTest-702241756 tempest-VolumesNegativeTest-702241756-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/12ed2997-b879-482f-b8d1-039cbc27bada" status: 404 len: 109 microversion: 2.1 time: 0.055503 Aug 26 09:01:42.933104 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 563/1136] 10.222.0.71 () {58 vars in 1245 bytes} [Fri Aug 26 09:01:42 2022] GET /compute/v2.1/os-volumes/12ed2997-b879-482f-b8d1-039cbc27bada => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 09:01:43.235762 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f116601f-d8ac-4e3f-9d46-2df0dc61e809 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:43.236504 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f116601f-d8ac-4e3f-9d46-2df0dc61e809 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:43.244376 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f116601f-d8ac-4e3f-9d46-2df0dc61e809 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:43.244884 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f116601f-d8ac-4e3f-9d46-2df0dc61e809 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:43.245371 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f116601f-d8ac-4e3f-9d46-2df0dc61e809 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:43.246067 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f116601f-d8ac-4e3f-9d46-2df0dc61e809 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:43.246633 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f116601f-d8ac-4e3f-9d46-2df0dc61e809 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:43.247092 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f116601f-d8ac-4e3f-9d46-2df0dc61e809 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:43.426223 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f116601f-d8ac-4e3f-9d46-2df0dc61e809 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:43.435346 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f116601f-d8ac-4e3f-9d46-2df0dc61e809 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1265 microversion: 2.1 time: 0.203578 Aug 26 09:01:43.436010 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 574/1137] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:43 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 09:01:44.462232 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0aad86b9-8ec0-4f63-a3a1-0a99cd0d410d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:44.463404 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0aad86b9-8ec0-4f63-a3a1-0a99cd0d410d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:44.473248 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0aad86b9-8ec0-4f63-a3a1-0a99cd0d410d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:44.474007 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0aad86b9-8ec0-4f63-a3a1-0a99cd0d410d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:44.474560 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0aad86b9-8ec0-4f63-a3a1-0a99cd0d410d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:44.475698 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0aad86b9-8ec0-4f63-a3a1-0a99cd0d410d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:44.476297 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0aad86b9-8ec0-4f63-a3a1-0a99cd0d410d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:44.476845 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0aad86b9-8ec0-4f63-a3a1-0a99cd0d410d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:44.655031 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-0aad86b9-8ec0-4f63-a3a1-0a99cd0d410d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:44.666396 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0aad86b9-8ec0-4f63-a3a1-0a99cd0d410d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1452 microversion: 2.1 time: 0.212771 Aug 26 09:01:44.673036 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 564/1138] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:44 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1452 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:44.686794 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-0a41dafa-67fd-43ed-b249-e95080ab03e7 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:01:44.687442 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-0a41dafa-67fd-43ed-b249-e95080ab03e7 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:44.695705 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0a41dafa-67fd-43ed-b249-e95080ab03e7 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:44.696588 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0a41dafa-67fd-43ed-b249-e95080ab03e7 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:44.697023 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0a41dafa-67fd-43ed-b249-e95080ab03e7 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:44.698042 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0a41dafa-67fd-43ed-b249-e95080ab03e7 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:44.699238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0a41dafa-67fd-43ed-b249-e95080ab03e7 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:44.700167 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-0a41dafa-67fd-43ed-b249-e95080ab03e7 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:44.745450 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-79b6575d-a92b-417e-af9b-b6d6dde6597e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c02f1efb-c72b-443e-aa8c-2d3ce35a760f", "device": "/dev/sdb"}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:01:44.764947 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-79b6575d-a92b-417e-af9b-b6d6dde6597e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:01:44.783336 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-79b6575d-a92b-417e-af9b-b6d6dde6597e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:44.795490 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-79b6575d-a92b-417e-af9b-b6d6dde6597e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:44.796174 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-79b6575d-a92b-417e-af9b-b6d6dde6597e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:44.797213 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-79b6575d-a92b-417e-af9b-b6d6dde6597e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:44.797929 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-79b6575d-a92b-417e-af9b-b6d6dde6597e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:44.798689 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-79b6575d-a92b-417e-af9b-b6d6dde6597e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:44.938323 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:44.940064 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-0a41dafa-67fd-43ed-b249-e95080ab03e7 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:01:44.942939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=100 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:01:44.955732 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-0a41dafa-67fd-43ed-b249-e95080ab03e7 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1452 microversion: 2.1 time: 0.272655 Aug 26 09:01:44.958982 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 575/1139] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:01:44 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1452 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:01:47.521305 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-e4fb22b3-47ac-40e2-b6eb-c58a54b1c799 req-2c8eb289-dda0-4ee0-8b4e-0a99644c9487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de326118-88c5-4143-ba33-ec222ab9a374", "tag": "4f8cb1f4-9a9e-4789-ab3a-fe22f32e08ea"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:01:47.546137 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-e4fb22b3-47ac-40e2-b6eb-c58a54b1c799 req-2c8eb289-dda0-4ee0-8b4e-0a99644c9487 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:01:47.546643 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-e4fb22b3-47ac-40e2-b6eb-c58a54b1c799 req-2c8eb289-dda0-4ee0-8b4e-0a99644c9487 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:01:47.547142 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-e4fb22b3-47ac-40e2-b6eb-c58a54b1c799 req-2c8eb289-dda0-4ee0-8b4e-0a99644c9487 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:01:47.571026 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-e4fb22b3-47ac-40e2-b6eb-c58a54b1c799 req-2c8eb289-dda0-4ee0-8b4e-0a99644c9487 service nova] Creating event network-changed:4f8cb1f4-9a9e-4789-ab3a-fe22f32e08ea for instance de326118-88c5-4143-ba33-ec222ab9a374 on hv-cinder-85236 Aug 26 09:01:47.582305 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-e4fb22b3-47ac-40e2-b6eb-c58a54b1c799 req-2c8eb289-dda0-4ee0-8b4e-0a99644c9487 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061924 Aug 26 09:01:47.583503 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 576/1140] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:01:47.766774 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-79b6575d-a92b-417e-af9b-b6d6dde6597e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "POST /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.029666 Aug 26 09:01:47.768911 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 565/1141] 10.222.0.71 () {60 vars in 1323 bytes} [Fri Aug 26 09:01:44 2022] POST /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15/os-volume_attachments => generated 194 bytes in 3033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 09:02:18.111943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6e2fc6e8-dfce-432f-bcae-54d01766ba0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:18.113444 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6e2fc6e8-dfce-432f-bcae-54d01766ba0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:18.116244 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:18.117300 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=3 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:18.126097 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e2fc6e8-dfce-432f-bcae-54d01766ba0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:18.126644 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e2fc6e8-dfce-432f-bcae-54d01766ba0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:18.127282 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e2fc6e8-dfce-432f-bcae-54d01766ba0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:18.127545 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e2fc6e8-dfce-432f-bcae-54d01766ba0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:18.128045 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e2fc6e8-dfce-432f-bcae-54d01766ba0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:18.128352 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6e2fc6e8-dfce-432f-bcae-54d01766ba0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:18.264594 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.objects.instance [None req-6e2fc6e8-dfce-432f-bcae-54d01766ba0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lazy-loading 'services' on Instance uuid 3e87910c-37ab-43c9-b76d-957282257a15 {{(pid=132217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 09:02:18.380687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6e2fc6e8-dfce-432f-bcae-54d01766ba0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "DELETE /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15/os-volume_attachments/c02f1efb-c72b-443e-aa8c-2d3ce35a760f" status: 202 len: 0 microversion: 2.1 time: 0.273083 Aug 26 09:02:18.381376 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 577/1142] 10.222.0.71 () {58 vars in 1416 bytes} [Fri Aug 26 09:02:18 2022] DELETE /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15/os-volume_attachments/c02f1efb-c72b-443e-aa8c-2d3ce35a760f => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 09:02:19.587368 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-84034370-7995-4965-903d-2620de819e20 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:19.589186 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-84034370-7995-4965-903d-2620de819e20 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:19.592404 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:19.593113 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=6,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:19.594198 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 09:02:19.594354 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Fri Aug 26 09:02:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 (ip 10.222.0.71) !!! Aug 26 09:02:19.602697 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-84034370-7995-4965-903d-2620de819e20 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:19.603636 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-84034370-7995-4965-903d-2620de819e20 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:19.603978 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-84034370-7995-4965-903d-2620de819e20 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:19.604713 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-84034370-7995-4965-903d-2620de819e20 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:19.605376 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-84034370-7995-4965-903d-2620de819e20 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:19.606246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-84034370-7995-4965-903d-2620de819e20 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:19.651269 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-84034370-7995-4965-903d-2620de819e20 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 09:02:19.767081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-84034370-7995-4965-903d-2620de819e20 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "DELETE /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 204 len: 0 microversion: 2.1 time: 0.185730 Aug 26 09:02:19.770524 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 566/1143] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 09:02:19 2022] DELETE /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 09:02:19.789867 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-25e656ed-16e0-4b7f-98fb-cff7b9ddde17 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:19.791061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-25e656ed-16e0-4b7f-98fb-cff7b9ddde17 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:19.803917 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25e656ed-16e0-4b7f-98fb-cff7b9ddde17 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:19.804276 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25e656ed-16e0-4b7f-98fb-cff7b9ddde17 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:19.804715 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25e656ed-16e0-4b7f-98fb-cff7b9ddde17 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:19.805651 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25e656ed-16e0-4b7f-98fb-cff7b9ddde17 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:19.806223 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25e656ed-16e0-4b7f-98fb-cff7b9ddde17 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:19.806650 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-25e656ed-16e0-4b7f-98fb-cff7b9ddde17 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:19.997449 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-25e656ed-16e0-4b7f-98fb-cff7b9ddde17 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:20.008928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-25e656ed-16e0-4b7f-98fb-cff7b9ddde17 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1513 microversion: 2.1 time: 0.233183 Aug 26 09:02:20.009749 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 578/1144] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:19 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 09:02:21.031956 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-8070d3fd-662b-4999-9cc9-939f56ec433d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:21.032668 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-8070d3fd-662b-4999-9cc9-939f56ec433d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:21.039851 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8070d3fd-662b-4999-9cc9-939f56ec433d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:21.040345 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8070d3fd-662b-4999-9cc9-939f56ec433d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:21.040780 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8070d3fd-662b-4999-9cc9-939f56ec433d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:21.041500 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8070d3fd-662b-4999-9cc9-939f56ec433d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:21.041960 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8070d3fd-662b-4999-9cc9-939f56ec433d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:21.042385 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-8070d3fd-662b-4999-9cc9-939f56ec433d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:21.213404 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-8070d3fd-662b-4999-9cc9-939f56ec433d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:21.223200 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-8070d3fd-662b-4999-9cc9-939f56ec433d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1513 microversion: 2.1 time: 0.195470 Aug 26 09:02:21.224219 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 567/1145] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:21 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:02:22.258528 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-de5870f2-235a-48d3-9adf-9aad6cd88d27 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:22.259311 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-de5870f2-235a-48d3-9adf-9aad6cd88d27 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:22.266168 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de5870f2-235a-48d3-9adf-9aad6cd88d27 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:22.267013 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de5870f2-235a-48d3-9adf-9aad6cd88d27 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:22.267547 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de5870f2-235a-48d3-9adf-9aad6cd88d27 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:22.268627 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de5870f2-235a-48d3-9adf-9aad6cd88d27 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:22.269270 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de5870f2-235a-48d3-9adf-9aad6cd88d27 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:22.269826 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-de5870f2-235a-48d3-9adf-9aad6cd88d27 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:22.470519 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-de5870f2-235a-48d3-9adf-9aad6cd88d27 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:22.485311 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-de5870f2-235a-48d3-9adf-9aad6cd88d27 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 200 len: 1513 microversion: 2.1 time: 0.230364 Aug 26 09:02:22.486841 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 579/1146] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:22 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:02:22.566340 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-20cfccfc-0bfb-4b9c-a3f3-529cc5f47f41 req-97ca6ff5-8516-4aa7-9c48-af2532891157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e87910c-37ab-43c9-b76d-957282257a15", "name": "network-vif-deleted", "tag": "6b259d13-3e81-43ea-89d3-6f544e3628b0"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:02:22.579135 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-20cfccfc-0bfb-4b9c-a3f3-529cc5f47f41 req-97ca6ff5-8516-4aa7-9c48-af2532891157 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:22.580454 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-20cfccfc-0bfb-4b9c-a3f3-529cc5f47f41 req-97ca6ff5-8516-4aa7-9c48-af2532891157 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:22.581751 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-20cfccfc-0bfb-4b9c-a3f3-529cc5f47f41 req-97ca6ff5-8516-4aa7-9c48-af2532891157 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:22.603500 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-20cfccfc-0bfb-4b9c-a3f3-529cc5f47f41 req-97ca6ff5-8516-4aa7-9c48-af2532891157 service nova] Creating event network-vif-deleted:6b259d13-3e81-43ea-89d3-6f544e3628b0 for instance 3e87910c-37ab-43c9-b76d-957282257a15 on hv-cinder-85236 Aug 26 09:02:22.615834 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-20cfccfc-0bfb-4b9c-a3f3-529cc5f47f41 req-97ca6ff5-8516-4aa7-9c48-af2532891157 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050023 Aug 26 09:02:22.617181 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 568/1147] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 09:02:23.519143 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4ec71cf2-efd2-4a44-a098-eee88645b936 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:23.520095 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-4ec71cf2-efd2-4a44-a098-eee88645b936 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 3e87910c-37ab-43c9-b76d-957282257a15] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:23.530068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4ec71cf2-efd2-4a44-a098-eee88645b936 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:23.530745 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4ec71cf2-efd2-4a44-a098-eee88645b936 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:23.531365 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4ec71cf2-efd2-4a44-a098-eee88645b936 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:23.532559 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4ec71cf2-efd2-4a44-a098-eee88645b936 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:23.533352 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4ec71cf2-efd2-4a44-a098-eee88645b936 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:23.533973 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-4ec71cf2-efd2-4a44-a098-eee88645b936 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:23.553675 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-4ec71cf2-efd2-4a44-a098-eee88645b936 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] HTTP exception thrown: Instance 3e87910c-37ab-43c9-b76d-957282257a15 could not be found. Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4ec71cf2-efd2-4a44-a098-eee88645b936 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Request method failure captured: Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 HTTP/1.1 Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIvTwYkFt--lwY7srZxqygHfHclXTjgnW4VLe3cpIm2yAA4YkDiQzDnouoe-Plw4pwyAmo6QleuMLbJmitfl1Ib9nBLOzuQn_JcisPXKzaTOo3dENsIqerdP69bT8No_-J50K-M04DwL8lK9Yx6w5sTqx10kvovBWeJFCosMsTSLNIM Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: eed42d5a00d44ae3af1d74159e20c616 Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2017692575 Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:02:23.555411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:02:23.558238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_eed42d5a00d44ae3af1d74159e20c616", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/eed42d5a00d44ae3af1d74159e20c616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/eed42d5a00d44ae3af1d74159e20c616"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/eed42d5a00d44ae3af1d74159e20c616"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:02:23.558238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-VolumesSnapshotTestJSON-2017692575 Aug 26 09:02:23.558238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: eed42d5a00d44ae3af1d74159e20c616 Aug 26 09:02:23.558238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2017692575 Aug 26 09:02:23.558238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-VolumesSnapshotTestJSON-2017692575-project Aug 26 09:02:23.558238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:02:23.558238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:02:23.558238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: d5e175245f2e48c79d5f82dbaf4f1cf4 Aug 26 09:02:23.558238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-VolumesSnapshotTestJSON-2017692575-project Aug 26 09:02:23.558238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:02:23.558238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance 3e87910c-37ab-43c9-b76d-957282257a15 could not be found. Aug 26 09:02:23.558238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '3e87910c-37ab-43c9-b76d-957282257a15'} Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e87910c-37ab-43c9-b76d-957282257a15 could not be found. Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:02:23.559744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e87910c-37ab-43c9-b76d-957282257a15 could not be found. Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e87910c-37ab-43c9-b76d-957282257a15 could not be found. Aug 26 09:02:23.562723 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:02:23.565531 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-4ec71cf2-efd2-4a44-a098-eee88645b936 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Returning 404 to user: Instance 3e87910c-37ab-43c9-b76d-957282257a15 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:02:23.565531 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-4ec71cf2-efd2-4a44-a098-eee88645b936 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15" status: 404 len: 111 microversion: 2.1 time: 0.043850 Aug 26 09:02:23.565531 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 580/1148] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:23 2022] GET /compute/v2.1/servers/3e87910c-37ab-43c9-b76d-957282257a15 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:02:37.891253 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:37.892242 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:37.898316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-712543438", "imageRef": "50f64ef3-28fb-4f19-9ac5-699a9cef9144", "flavorRef": "452", "networks": [{"uuid": "0ee037e3-9323-4dcd-a48f-6da1ecb6f1f9"}]}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:02:37.963491 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.network.neutron [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] validate_networks() for [('0ee037e3-9323-4dcd-a48f-6da1ecb6f1f9', None, None, None, None, None)] {{(pid=132218) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 09:02:38.550122 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Flavor limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 09:02:38.550632 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Image limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 09:02:38.551126 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Flavor pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 09:02:38.551670 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Image pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 09:02:38.552081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 09:02:38.563090 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:38.563741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:38.564284 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:38.565134 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:38.565691 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:38.566233 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:38.586066 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Getting quotas for project eed42d5a00d44ae3af1d74159e20c616. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 09:02:38.590741 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Getting quotas for user d5e175245f2e48c79d5f82dbaf4f1cf4 and project eed42d5a00d44ae3af1d74159e20c616. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 09:02:38.604891 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Going to run 1 instances... {{(pid=132218) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 09:02:38.607383 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='50f64ef3-28fb-4f19-9ac5-699a9cef9144',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132218) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 09:02:38.669169 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ba8a732b-7a6b-4762-b633-f07227899bc5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779862 Aug 26 09:02:38.670249 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 569/1149] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 09:02:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 09:02:38.699609 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-9fb9f725-a075-4bec-9ee2-cf801bd8e9b4 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:38.700394 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-9fb9f725-a075-4bec-9ee2-cf801bd8e9b4 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:38.702848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=8 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:38.703614 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:38.797381 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-9fb9f725-a075-4bec-9ee2-cf801bd8e9b4 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:38.808516 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-9fb9f725-a075-4bec-9ee2-cf801bd8e9b4 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1218 microversion: 2.1 time: 0.123924 Aug 26 09:02:38.809494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 581/1150] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:38 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:02:39.838535 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5d5e0498-fae6-43f5-84a7-6bd96cf98d0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:39.839601 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5d5e0498-fae6-43f5-84a7-6bd96cf98d0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:39.849051 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5d5e0498-fae6-43f5-84a7-6bd96cf98d0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:39.849715 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5d5e0498-fae6-43f5-84a7-6bd96cf98d0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:39.850457 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5d5e0498-fae6-43f5-84a7-6bd96cf98d0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:39.851605 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5d5e0498-fae6-43f5-84a7-6bd96cf98d0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:39.853219 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5d5e0498-fae6-43f5-84a7-6bd96cf98d0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:39.854260 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5d5e0498-fae6-43f5-84a7-6bd96cf98d0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:39.937628 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5d5e0498-fae6-43f5-84a7-6bd96cf98d0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:39.946375 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5d5e0498-fae6-43f5-84a7-6bd96cf98d0f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1270 microversion: 2.1 time: 0.115259 Aug 26 09:02:39.946998 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 570/1151] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:39 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1270 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 09:02:40.971038 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a3483ab7-4080-4461-9103-9c65e3f51853 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:40.974391 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a3483ab7-4080-4461-9103-9c65e3f51853 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:40.991619 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a3483ab7-4080-4461-9103-9c65e3f51853 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:40.992788 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a3483ab7-4080-4461-9103-9c65e3f51853 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:40.994043 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a3483ab7-4080-4461-9103-9c65e3f51853 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:40.995464 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a3483ab7-4080-4461-9103-9c65e3f51853 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:40.996102 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a3483ab7-4080-4461-9103-9c65e3f51853 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:40.996941 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a3483ab7-4080-4461-9103-9c65e3f51853 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:41.118494 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a3483ab7-4080-4461-9103-9c65e3f51853 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:41.130259 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a3483ab7-4080-4461-9103-9c65e3f51853 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1276 microversion: 2.1 time: 0.164615 Aug 26 09:02:41.131822 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 582/1152] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:40 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:02:42.153671 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d7a43313-8722-4e59-a346-488ee3063164 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:42.154631 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d7a43313-8722-4e59-a346-488ee3063164 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:42.161990 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7a43313-8722-4e59-a346-488ee3063164 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:42.162656 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7a43313-8722-4e59-a346-488ee3063164 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:42.163227 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7a43313-8722-4e59-a346-488ee3063164 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:42.164202 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7a43313-8722-4e59-a346-488ee3063164 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:42.164750 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7a43313-8722-4e59-a346-488ee3063164 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:42.165528 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d7a43313-8722-4e59-a346-488ee3063164 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:42.439759 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d7a43313-8722-4e59-a346-488ee3063164 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:42.452856 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d7a43313-8722-4e59-a346-488ee3063164 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1318 microversion: 2.1 time: 0.302844 Aug 26 09:02:42.463760 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 571/1153] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:42 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:02:42.867528 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-7ccd1059-9481-46d9-b64e-9eb1a465206e req-24ec17fe-6f24-480b-88f7-eab29d2afb8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dcb5cd8-08de-4851-9562-7f2aac0a6480", "tag": "1e4c5c3e-ae99-41ce-a086-be5672b47132"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:02:42.877907 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-7ccd1059-9481-46d9-b64e-9eb1a465206e req-24ec17fe-6f24-480b-88f7-eab29d2afb8c service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:42.878406 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-7ccd1059-9481-46d9-b64e-9eb1a465206e req-24ec17fe-6f24-480b-88f7-eab29d2afb8c service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:42.878828 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-7ccd1059-9481-46d9-b64e-9eb1a465206e req-24ec17fe-6f24-480b-88f7-eab29d2afb8c service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:42.896832 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-7ccd1059-9481-46d9-b64e-9eb1a465206e req-24ec17fe-6f24-480b-88f7-eab29d2afb8c service nova] Creating event network-changed:1e4c5c3e-ae99-41ce-a086-be5672b47132 for instance 0dcb5cd8-08de-4851-9562-7f2aac0a6480 on hv-cinder-85236 Aug 26 09:02:42.902560 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-7ccd1059-9481-46d9-b64e-9eb1a465206e req-24ec17fe-6f24-480b-88f7-eab29d2afb8c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.288140 Aug 26 09:02:42.903217 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 583/1154] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:02:43.477093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-bd87ae2f-47d9-4dc5-80e9-08a68c8f2ed6 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:43.477830 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-bd87ae2f-47d9-4dc5-80e9-08a68c8f2ed6 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:43.486441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bd87ae2f-47d9-4dc5-80e9-08a68c8f2ed6 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:43.487020 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bd87ae2f-47d9-4dc5-80e9-08a68c8f2ed6 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:43.487433 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bd87ae2f-47d9-4dc5-80e9-08a68c8f2ed6 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:43.488305 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bd87ae2f-47d9-4dc5-80e9-08a68c8f2ed6 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:43.488757 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bd87ae2f-47d9-4dc5-80e9-08a68c8f2ed6 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:43.489330 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-bd87ae2f-47d9-4dc5-80e9-08a68c8f2ed6 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:43.650074 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-bd87ae2f-47d9-4dc5-80e9-08a68c8f2ed6 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:43.659250 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-bd87ae2f-47d9-4dc5-80e9-08a68c8f2ed6 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1318 microversion: 2.1 time: 0.186649 Aug 26 09:02:43.659976 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 572/1155] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:43 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:02:44.684641 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-792a6f82-4a6b-4fec-bb1d-c6f07a0ac451 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:44.685445 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-792a6f82-4a6b-4fec-bb1d-c6f07a0ac451 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:44.693097 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-792a6f82-4a6b-4fec-bb1d-c6f07a0ac451 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:44.693587 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-792a6f82-4a6b-4fec-bb1d-c6f07a0ac451 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:44.694011 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-792a6f82-4a6b-4fec-bb1d-c6f07a0ac451 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:44.694714 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-792a6f82-4a6b-4fec-bb1d-c6f07a0ac451 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:44.695201 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-792a6f82-4a6b-4fec-bb1d-c6f07a0ac451 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:44.695613 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-792a6f82-4a6b-4fec-bb1d-c6f07a0ac451 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:44.842545 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-792a6f82-4a6b-4fec-bb1d-c6f07a0ac451 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:44.851138 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-792a6f82-4a6b-4fec-bb1d-c6f07a0ac451 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1318 microversion: 2.1 time: 0.172770 Aug 26 09:02:44.851730 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 584/1156] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:44 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:02:45.872887 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2a010379-fddb-41ee-a9a9-091428378628 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:45.873551 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-2a010379-fddb-41ee-a9a9-091428378628 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:45.880002 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a010379-fddb-41ee-a9a9-091428378628 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:45.880634 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a010379-fddb-41ee-a9a9-091428378628 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:45.881071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a010379-fddb-41ee-a9a9-091428378628 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:45.881783 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a010379-fddb-41ee-a9a9-091428378628 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:45.882264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a010379-fddb-41ee-a9a9-091428378628 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:45.882675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-2a010379-fddb-41ee-a9a9-091428378628 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:46.029946 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-2a010379-fddb-41ee-a9a9-091428378628 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:46.038550 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2a010379-fddb-41ee-a9a9-091428378628 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1318 microversion: 2.1 time: 0.169521 Aug 26 09:02:46.039192 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 573/1157] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:45 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:02:47.061209 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-02fcc5ee-56af-4b02-81b9-15b1f7780cc8 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:47.061876 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-02fcc5ee-56af-4b02-81b9-15b1f7780cc8 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:47.071738 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-02fcc5ee-56af-4b02-81b9-15b1f7780cc8 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:47.071738 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-02fcc5ee-56af-4b02-81b9-15b1f7780cc8 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:47.071738 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-02fcc5ee-56af-4b02-81b9-15b1f7780cc8 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:47.071738 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-02fcc5ee-56af-4b02-81b9-15b1f7780cc8 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:47.072221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-02fcc5ee-56af-4b02-81b9-15b1f7780cc8 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:47.072221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-02fcc5ee-56af-4b02-81b9-15b1f7780cc8 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:47.229944 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-02fcc5ee-56af-4b02-81b9-15b1f7780cc8 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:47.238564 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-02fcc5ee-56af-4b02-81b9-15b1f7780cc8 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1318 microversion: 2.1 time: 0.181452 Aug 26 09:02:47.239249 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 585/1158] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:47 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:02:48.264194 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-4f518fb2-9634-4833-8f0e-91f265f6a461 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:48.265032 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-4f518fb2-9634-4833-8f0e-91f265f6a461 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:48.272368 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f518fb2-9634-4833-8f0e-91f265f6a461 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:48.272859 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f518fb2-9634-4833-8f0e-91f265f6a461 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:48.273338 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f518fb2-9634-4833-8f0e-91f265f6a461 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:48.274071 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f518fb2-9634-4833-8f0e-91f265f6a461 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:48.274523 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f518fb2-9634-4833-8f0e-91f265f6a461 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:48.274976 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-4f518fb2-9634-4833-8f0e-91f265f6a461 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:48.425338 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-4f518fb2-9634-4833-8f0e-91f265f6a461 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:48.433922 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-4f518fb2-9634-4833-8f0e-91f265f6a461 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1318 microversion: 2.1 time: 0.173989 Aug 26 09:02:48.434504 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 574/1159] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:48 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 09:02:49.313020 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:49.406524 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-fa0c1c51-d24f-42d9-8c67-6b7f7d0dbb24 req-e66a7bd5-b61e-4d36-a858-560ddd990374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcb5cd8-08de-4851-9562-7f2aac0a6480", "name": "network-vif-plugged", "status": "completed", "tag": "1e4c5c3e-ae99-41ce-a086-be5672b47132"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:02:49.423825 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-fa0c1c51-d24f-42d9-8c67-6b7f7d0dbb24 req-e66a7bd5-b61e-4d36-a858-560ddd990374 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:49.424614 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-fa0c1c51-d24f-42d9-8c67-6b7f7d0dbb24 req-e66a7bd5-b61e-4d36-a858-560ddd990374 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:49.425333 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-fa0c1c51-d24f-42d9-8c67-6b7f7d0dbb24 req-e66a7bd5-b61e-4d36-a858-560ddd990374 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:49.447096 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-fa0c1c51-d24f-42d9-8c67-6b7f7d0dbb24 req-e66a7bd5-b61e-4d36-a858-560ddd990374 service nova] Creating event network-vif-plugged:1e4c5c3e-ae99-41ce-a086-be5672b47132 for instance 0dcb5cd8-08de-4851-9562-7f2aac0a6480 on hv-cinder-85236 Aug 26 09:02:49.457596 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-fa0c1c51-d24f-42d9-8c67-6b7f7d0dbb24 req-e66a7bd5-b61e-4d36-a858-560ddd990374 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151514 Aug 26 09:02:49.459058 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 586/1160] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:02:49.460635 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a27f8099-05e4-4fdf-b455-335db8077c22 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:49.462064 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a27f8099-05e4-4fdf-b455-335db8077c22 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:49.464481 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:49.465345 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=6 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:02:49.476094 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a27f8099-05e4-4fdf-b455-335db8077c22 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:49.476835 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a27f8099-05e4-4fdf-b455-335db8077c22 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:49.477406 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a27f8099-05e4-4fdf-b455-335db8077c22 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:49.478273 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a27f8099-05e4-4fdf-b455-335db8077c22 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:49.479024 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a27f8099-05e4-4fdf-b455-335db8077c22 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:49.479722 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a27f8099-05e4-4fdf-b455-335db8077c22 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:49.667849 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-a27f8099-05e4-4fdf-b455-335db8077c22 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:49.677236 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a27f8099-05e4-4fdf-b455-335db8077c22 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1318 microversion: 2.1 time: 0.223571 Aug 26 09:02:49.678038 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 575/1161] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:49 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:02:50.717838 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-22e4d186-fe49-4e45-bf36-15039bb34da5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:50.718530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-22e4d186-fe49-4e45-bf36-15039bb34da5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:50.725767 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-22e4d186-fe49-4e45-bf36-15039bb34da5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:50.726238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-22e4d186-fe49-4e45-bf36-15039bb34da5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:50.726664 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-22e4d186-fe49-4e45-bf36-15039bb34da5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:50.727398 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-22e4d186-fe49-4e45-bf36-15039bb34da5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:50.727849 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-22e4d186-fe49-4e45-bf36-15039bb34da5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:50.728270 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-22e4d186-fe49-4e45-bf36-15039bb34da5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:50.871689 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-22e4d186-fe49-4e45-bf36-15039bb34da5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:50.882935 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-22e4d186-fe49-4e45-bf36-15039bb34da5 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1318 microversion: 2.1 time: 0.169963 Aug 26 09:02:50.884115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 587/1162] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:50 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:02:51.905672 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-01a1cce0-fe51-4cab-a772-535f1e5f56fa tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:02:51.906348 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-01a1cce0-fe51-4cab-a772-535f1e5f56fa tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:51.913962 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-01a1cce0-fe51-4cab-a772-535f1e5f56fa tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:51.914427 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-01a1cce0-fe51-4cab-a772-535f1e5f56fa tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:51.914860 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-01a1cce0-fe51-4cab-a772-535f1e5f56fa tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:51.916083 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-01a1cce0-fe51-4cab-a772-535f1e5f56fa tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:51.916546 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-01a1cce0-fe51-4cab-a772-535f1e5f56fa tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:51.916970 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-01a1cce0-fe51-4cab-a772-535f1e5f56fa tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:52.075968 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-01a1cce0-fe51-4cab-a772-535f1e5f56fa tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:02:52.085350 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-01a1cce0-fe51-4cab-a772-535f1e5f56fa tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1507 microversion: 2.1 time: 0.183719 Aug 26 09:02:52.085958 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 576/1163] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:02:51 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:02:52.106618 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-77c93916-0b24-42ce-9595-abba28565dac tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1db65b2a-81ee-40c1-b068-684cb7c386e2", "device": "/dev/sdb"}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:02:52.109554 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-77c93916-0b24-42ce-9595-abba28565dac tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:02:52.117572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77c93916-0b24-42ce-9595-abba28565dac tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:52.118068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77c93916-0b24-42ce-9595-abba28565dac tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:52.118687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77c93916-0b24-42ce-9595-abba28565dac tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:52.119469 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77c93916-0b24-42ce-9595-abba28565dac tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:02:52.119913 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77c93916-0b24-42ce-9595-abba28565dac tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:02:52.120322 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77c93916-0b24-42ce-9595-abba28565dac tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:02:52.423903 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-77c93916-0b24-42ce-9595-abba28565dac tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "POST /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321426 Aug 26 09:02:52.424582 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 588/1164] 10.222.0.71 () {60 vars in 1323 bytes} [Fri Aug 26 09:02:52 2022] POST /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:03:17.217381 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-0d8699fa-c2ea-4ac9-b5e7-f4f0a1cdc92e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:03:17.217999 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-0d8699fa-c2ea-4ac9-b5e7-f4f0a1cdc92e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:03:17.220107 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:17.220766 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=44 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:17.229296 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0d8699fa-c2ea-4ac9-b5e7-f4f0a1cdc92e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:17.229790 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0d8699fa-c2ea-4ac9-b5e7-f4f0a1cdc92e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:17.230222 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0d8699fa-c2ea-4ac9-b5e7-f4f0a1cdc92e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:17.230981 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0d8699fa-c2ea-4ac9-b5e7-f4f0a1cdc92e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:17.231564 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0d8699fa-c2ea-4ac9-b5e7-f4f0a1cdc92e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:17.231846 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-0d8699fa-c2ea-4ac9-b5e7-f4f0a1cdc92e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:17.336745 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-0d8699fa-c2ea-4ac9-b5e7-f4f0a1cdc92e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lazy-loading 'services' on Instance uuid 0dcb5cd8-08de-4851-9562-7f2aac0a6480 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 09:03:17.433668 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-0d8699fa-c2ea-4ac9-b5e7-f4f0a1cdc92e tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "DELETE /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480/os-volume_attachments/1db65b2a-81ee-40c1-b068-684cb7c386e2" status: 202 len: 0 microversion: 2.1 time: 0.220171 Aug 26 09:03:17.434592 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 577/1165] 10.222.0.71 () {58 vars in 1416 bytes} [Fri Aug 26 09:03:17 2022] DELETE /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480/os-volume_attachments/1db65b2a-81ee-40c1-b068-684cb7c386e2 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 09:03:18.592744 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=18 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:18.593611 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:03:18.597907 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6336ce1c-887d-469c-baa5-f1c56776771a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:03:18.598447 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6336ce1c-887d-469c-baa5-f1c56776771a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:03:18.605541 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6336ce1c-887d-469c-baa5-f1c56776771a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:18.606041 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6336ce1c-887d-469c-baa5-f1c56776771a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:18.606459 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6336ce1c-887d-469c-baa5-f1c56776771a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:18.607391 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6336ce1c-887d-469c-baa5-f1c56776771a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:18.607843 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6336ce1c-887d-469c-baa5-f1c56776771a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:18.608285 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6336ce1c-887d-469c-baa5-f1c56776771a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:18.637097 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6336ce1c-887d-469c-baa5-f1c56776771a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Going to try to terminate instance {{(pid=132217) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 09:03:18.725007 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6336ce1c-887d-469c-baa5-f1c56776771a tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "DELETE /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 204 len: 0 microversion: 2.1 time: 0.133458 Aug 26 09:03:18.725876 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 589/1166] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 09:03:18 2022] DELETE /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 09:03:18.735664 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ea8f4e33-0046-49c1-babc-a330da2c2bec tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:03:18.736377 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ea8f4e33-0046-49c1-babc-a330da2c2bec tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:03:18.744338 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ea8f4e33-0046-49c1-babc-a330da2c2bec tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:18.744799 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ea8f4e33-0046-49c1-babc-a330da2c2bec tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:18.745428 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ea8f4e33-0046-49c1-babc-a330da2c2bec tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:18.746334 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ea8f4e33-0046-49c1-babc-a330da2c2bec tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:18.746997 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ea8f4e33-0046-49c1-babc-a330da2c2bec tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:18.747432 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ea8f4e33-0046-49c1-babc-a330da2c2bec tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:18.908264 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ea8f4e33-0046-49c1-babc-a330da2c2bec tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:03:18.917842 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ea8f4e33-0046-49c1-babc-a330da2c2bec tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1513 microversion: 2.1 time: 0.186851 Aug 26 09:03:18.918491 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 578/1167] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:03:18 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:03:19.940030 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-771e82ca-5484-4887-9487-aa75f2844b2f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:03:19.940820 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-771e82ca-5484-4887-9487-aa75f2844b2f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:03:19.948155 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-771e82ca-5484-4887-9487-aa75f2844b2f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:19.948655 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-771e82ca-5484-4887-9487-aa75f2844b2f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:19.949108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-771e82ca-5484-4887-9487-aa75f2844b2f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:19.949936 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-771e82ca-5484-4887-9487-aa75f2844b2f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:19.950412 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-771e82ca-5484-4887-9487-aa75f2844b2f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:19.950858 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-771e82ca-5484-4887-9487-aa75f2844b2f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:20.091933 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-771e82ca-5484-4887-9487-aa75f2844b2f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:03:20.100425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-771e82ca-5484-4887-9487-aa75f2844b2f tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1513 microversion: 2.1 time: 0.164668 Aug 26 09:03:20.100976 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 590/1168] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:03:19 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:03:21.122257 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5f61b11c-111f-40cc-9b22-a540fd3bbad2 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:03:21.123000 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5f61b11c-111f-40cc-9b22-a540fd3bbad2 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:03:21.130608 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5f61b11c-111f-40cc-9b22-a540fd3bbad2 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:21.131129 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5f61b11c-111f-40cc-9b22-a540fd3bbad2 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:21.131588 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5f61b11c-111f-40cc-9b22-a540fd3bbad2 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:21.132304 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5f61b11c-111f-40cc-9b22-a540fd3bbad2 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:21.132899 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5f61b11c-111f-40cc-9b22-a540fd3bbad2 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:21.133321 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5f61b11c-111f-40cc-9b22-a540fd3bbad2 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:21.276544 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5f61b11c-111f-40cc-9b22-a540fd3bbad2 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:03:21.287324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5f61b11c-111f-40cc-9b22-a540fd3bbad2 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1513 microversion: 2.1 time: 0.168335 Aug 26 09:03:21.288247 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 579/1169] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:03:21 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:03:22.309467 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2ab82ac1-b626-46d0-b344-546a28eeb835 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:03:22.310086 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2ab82ac1-b626-46d0-b344-546a28eeb835 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:03:22.317168 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2ab82ac1-b626-46d0-b344-546a28eeb835 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:22.317619 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2ab82ac1-b626-46d0-b344-546a28eeb835 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:22.318046 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2ab82ac1-b626-46d0-b344-546a28eeb835 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:22.319149 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2ab82ac1-b626-46d0-b344-546a28eeb835 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:22.319279 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2ab82ac1-b626-46d0-b344-546a28eeb835 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:22.319730 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2ab82ac1-b626-46d0-b344-546a28eeb835 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:22.456925 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-2ab82ac1-b626-46d0-b344-546a28eeb835 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:03:22.465360 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2ab82ac1-b626-46d0-b344-546a28eeb835 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1513 microversion: 2.1 time: 0.159819 Aug 26 09:03:22.465953 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 591/1170] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:03:22 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:03:23.487014 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-794c23ca-b38f-4f13-82cb-6a42a89c4f58 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:03:23.487663 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-794c23ca-b38f-4f13-82cb-6a42a89c4f58 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:03:23.494405 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-794c23ca-b38f-4f13-82cb-6a42a89c4f58 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:23.495007 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-794c23ca-b38f-4f13-82cb-6a42a89c4f58 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:23.495324 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-794c23ca-b38f-4f13-82cb-6a42a89c4f58 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:23.496001 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-794c23ca-b38f-4f13-82cb-6a42a89c4f58 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:23.496503 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-794c23ca-b38f-4f13-82cb-6a42a89c4f58 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:23.496838 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-794c23ca-b38f-4f13-82cb-6a42a89c4f58 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:23.551350 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-100b8465-d478-4605-be56-a7bf946632b4 req-589eb251-7679-4ca2-a975-935acc91ae85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcb5cd8-08de-4851-9562-7f2aac0a6480", "name": "network-vif-deleted", "tag": "1e4c5c3e-ae99-41ce-a086-be5672b47132"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:03:23.561952 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-100b8465-d478-4605-be56-a7bf946632b4 req-589eb251-7679-4ca2-a975-935acc91ae85 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:23.562492 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-100b8465-d478-4605-be56-a7bf946632b4 req-589eb251-7679-4ca2-a975-935acc91ae85 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:23.562873 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-100b8465-d478-4605-be56-a7bf946632b4 req-589eb251-7679-4ca2-a975-935acc91ae85 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:23.576637 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-100b8465-d478-4605-be56-a7bf946632b4 req-589eb251-7679-4ca2-a975-935acc91ae85 service nova] Creating event network-vif-deleted:1e4c5c3e-ae99-41ce-a086-be5672b47132 for instance 0dcb5cd8-08de-4851-9562-7f2aac0a6480 on hv-cinder-85236 Aug 26 09:03:23.583365 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-794c23ca-b38f-4f13-82cb-6a42a89c4f58 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e175245f2e48c79d5f82dbaf4f1cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed42d5a00d44ae3af1d74159e20c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:03:23.584969 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-100b8465-d478-4605-be56-a7bf946632b4 req-589eb251-7679-4ca2-a975-935acc91ae85 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037374 Aug 26 09:03:23.586436 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 592/1171] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:03:23.592269 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-794c23ca-b38f-4f13-82cb-6a42a89c4f58 tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 200 len: 1471 microversion: 2.1 time: 0.109194 Aug 26 09:03:23.592878 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 580/1172] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:03:23 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 1471 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:03:24.615243 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-201415b5-d295-41da-82b5-7012a5c0de1d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:03:24.615831 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-201415b5-d295-41da-82b5-7012a5c0de1d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] [instance: 0dcb5cd8-08de-4851-9562-7f2aac0a6480] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:03:24.622457 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-201415b5-d295-41da-82b5-7012a5c0de1d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:24.622955 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-201415b5-d295-41da-82b5-7012a5c0de1d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:24.623432 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-201415b5-d295-41da-82b5-7012a5c0de1d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:24.624125 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-201415b5-d295-41da-82b5-7012a5c0de1d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:03:24.624561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-201415b5-d295-41da-82b5-7012a5c0de1d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:03:24.624970 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-201415b5-d295-41da-82b5-7012a5c0de1d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:03:24.640090 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-201415b5-d295-41da-82b5-7012a5c0de1d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] HTTP exception thrown: Instance 0dcb5cd8-08de-4851-9562-7f2aac0a6480 could not be found. Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-201415b5-d295-41da-82b5-7012a5c0de1d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Request method failure captured: Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 HTTP/1.1 Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIvTwYkFt--lwY7srZxqygHfHclXTjgnW4VLe3cpIm2yAA4YkDiQzDnouoe-Plw4pwyAmo6QleuMLbJmitfl1Ib9nBLOzuQn_JcisPXKzaTOo3dENsIqerdP69bT8No_-J50K-M04DwL8lK9Yx6w5sTqx10kvovBWeJFCosMsTSLNIM Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: eed42d5a00d44ae3af1d74159e20c616 Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2017692575 Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:03:24.641690 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:03:24.644170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_eed42d5a00d44ae3af1d74159e20c616", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/eed42d5a00d44ae3af1d74159e20c616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/eed42d5a00d44ae3af1d74159e20c616"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/eed42d5a00d44ae3af1d74159e20c616"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:03:24.644170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-VolumesSnapshotTestJSON-2017692575 Aug 26 09:03:24.644170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: eed42d5a00d44ae3af1d74159e20c616 Aug 26 09:03:24.644170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2017692575 Aug 26 09:03:24.644170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-VolumesSnapshotTestJSON-2017692575-project Aug 26 09:03:24.644170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:03:24.644170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:03:24.644170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: d5e175245f2e48c79d5f82dbaf4f1cf4 Aug 26 09:03:24.644170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-VolumesSnapshotTestJSON-2017692575-project Aug 26 09:03:24.644170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:03:24.644170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance 0dcb5cd8-08de-4851-9562-7f2aac0a6480 could not be found. Aug 26 09:03:24.644170 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '0dcb5cd8-08de-4851-9562-7f2aac0a6480'} Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcb5cd8-08de-4851-9562-7f2aac0a6480 could not be found. Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:03:24.645061 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcb5cd8-08de-4851-9562-7f2aac0a6480 could not be found. Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcb5cd8-08de-4851-9562-7f2aac0a6480 could not be found. Aug 26 09:03:24.647943 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:03:24.649629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-201415b5-d295-41da-82b5-7012a5c0de1d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] Returning 404 to user: Instance 0dcb5cd8-08de-4851-9562-7f2aac0a6480 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:03:24.649629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-201415b5-d295-41da-82b5-7012a5c0de1d tempest-VolumesSnapshotTestJSON-2017692575 tempest-VolumesSnapshotTestJSON-2017692575-project] 10.222.0.71 "GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480" status: 404 len: 111 microversion: 2.1 time: 0.032941 Aug 26 09:03:24.649629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 593/1173] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:03:24 2022] GET /compute/v2.1/servers/0dcb5cd8-08de-4851-9562-7f2aac0a6480 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:04:15.958364 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ea60887d-5a4d-4758-b134-8721a40d9b11 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:15.958364 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ea60887d-5a4d-4758-b134-8721a40d9b11 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:15.961070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=8 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:15.961809 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:15.962705 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 09:04:15.963001 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Fri Aug 26 09:04:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 (ip 10.222.0.71) !!! Aug 26 09:04:15.975133 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ea60887d-5a4d-4758-b134-8721a40d9b11 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:15.975617 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ea60887d-5a4d-4758-b134-8721a40d9b11 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:15.976053 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ea60887d-5a4d-4758-b134-8721a40d9b11 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:15.976817 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ea60887d-5a4d-4758-b134-8721a40d9b11 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:15.977381 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ea60887d-5a4d-4758-b134-8721a40d9b11 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:15.977856 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ea60887d-5a4d-4758-b134-8721a40d9b11 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:16.006284 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ea60887d-5a4d-4758-b134-8721a40d9b11 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 09:04:16.090216 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ea60887d-5a4d-4758-b134-8721a40d9b11 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "DELETE /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 204 len: 0 microversion: 2.1 time: 0.139039 Aug 26 09:04:16.090852 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 581/1174] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 09:04:15 2022] DELETE /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 09:04:16.099330 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-dfcb3784-cbeb-450d-89b7-91607819b526 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:16.100069 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-dfcb3784-cbeb-450d-89b7-91607819b526 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:16.102252 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:16.103254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:16.104484 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 09:04:16.104616 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Fri Aug 26 09:04:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 (ip 10.222.0.71) !!! Aug 26 09:04:16.105736 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 09:04:16.105904 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Fri Aug 26 09:04:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 (ip 10.222.0.71) !!! Aug 26 09:04:16.113687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dfcb3784-cbeb-450d-89b7-91607819b526 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:16.114173 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dfcb3784-cbeb-450d-89b7-91607819b526 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:16.114595 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dfcb3784-cbeb-450d-89b7-91607819b526 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:16.115350 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dfcb3784-cbeb-450d-89b7-91607819b526 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:16.115800 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dfcb3784-cbeb-450d-89b7-91607819b526 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:16.116304 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-dfcb3784-cbeb-450d-89b7-91607819b526 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:16.260558 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-dfcb3784-cbeb-450d-89b7-91607819b526 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:16.273214 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-dfcb3784-cbeb-450d-89b7-91607819b526 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1576 microversion: 2.1 time: 0.177704 Aug 26 09:04:16.274080 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 594/1175] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:16 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:17.297009 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-92da7480-775a-413d-864a-546a85bec592 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:17.297817 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-92da7480-775a-413d-864a-546a85bec592 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:17.306675 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-92da7480-775a-413d-864a-546a85bec592 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:17.307112 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-92da7480-775a-413d-864a-546a85bec592 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:17.307581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-92da7480-775a-413d-864a-546a85bec592 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:17.308375 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-92da7480-775a-413d-864a-546a85bec592 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:17.308921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-92da7480-775a-413d-864a-546a85bec592 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:17.309493 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-92da7480-775a-413d-864a-546a85bec592 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:17.476493 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-92da7480-775a-413d-864a-546a85bec592 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:17.485402 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-92da7480-775a-413d-864a-546a85bec592 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1576 microversion: 2.1 time: 0.193070 Aug 26 09:04:17.486013 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 582/1176] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:17 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:18.523462 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-1b0e819d-b69e-4b02-89a0-bbfaa5eec0fc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:18.524652 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-1b0e819d-b69e-4b02-89a0-bbfaa5eec0fc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:18.537751 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b0e819d-b69e-4b02-89a0-bbfaa5eec0fc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:18.538618 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b0e819d-b69e-4b02-89a0-bbfaa5eec0fc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:18.539419 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b0e819d-b69e-4b02-89a0-bbfaa5eec0fc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:18.540710 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b0e819d-b69e-4b02-89a0-bbfaa5eec0fc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:18.541513 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b0e819d-b69e-4b02-89a0-bbfaa5eec0fc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:18.542265 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-1b0e819d-b69e-4b02-89a0-bbfaa5eec0fc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:18.738224 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-1b0e819d-b69e-4b02-89a0-bbfaa5eec0fc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:18.747578 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-1b0e819d-b69e-4b02-89a0-bbfaa5eec0fc tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1576 microversion: 2.1 time: 0.228823 Aug 26 09:04:18.748350 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 595/1177] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:18 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1576 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:19.774569 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-d5b49295-b796-401b-b0b4-461ee6957204 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:19.775315 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-d5b49295-b796-401b-b0b4-461ee6957204 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:19.782665 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d5b49295-b796-401b-b0b4-461ee6957204 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:19.783496 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d5b49295-b796-401b-b0b4-461ee6957204 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:19.783496 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d5b49295-b796-401b-b0b4-461ee6957204 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:19.784244 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d5b49295-b796-401b-b0b4-461ee6957204 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:19.784721 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d5b49295-b796-401b-b0b4-461ee6957204 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:19.785026 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-d5b49295-b796-401b-b0b4-461ee6957204 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:19.964742 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-d5b49295-b796-401b-b0b4-461ee6957204 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:19.973765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-d5b49295-b796-401b-b0b4-461ee6957204 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1576 microversion: 2.1 time: 0.204085 Aug 26 09:04:19.974587 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 583/1178] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:19 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:21.001181 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-67dd7007-bd5d-4565-bd0c-a54024b4209c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:21.001795 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-67dd7007-bd5d-4565-bd0c-a54024b4209c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:21.008709 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-67dd7007-bd5d-4565-bd0c-a54024b4209c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:21.009190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-67dd7007-bd5d-4565-bd0c-a54024b4209c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:21.009609 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-67dd7007-bd5d-4565-bd0c-a54024b4209c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:21.010292 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-67dd7007-bd5d-4565-bd0c-a54024b4209c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:21.010826 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-67dd7007-bd5d-4565-bd0c-a54024b4209c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:21.011783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-67dd7007-bd5d-4565-bd0c-a54024b4209c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:21.166741 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-67dd7007-bd5d-4565-bd0c-a54024b4209c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:21.174922 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-67dd7007-bd5d-4565-bd0c-a54024b4209c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1576 microversion: 2.1 time: 0.177791 Aug 26 09:04:21.175509 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 596/1179] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:20 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 09:04:21.910295 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-3f4281ba-30df-4edc-adae-08df6c6084f4 req-a5afa91e-fdf6-45a9-b355-ee1d37f605d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de326118-88c5-4143-ba33-ec222ab9a374", "name": "network-vif-unplugged", "status": "completed", "tag": "4f8cb1f4-9a9e-4789-ab3a-fe22f32e08ea"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:04:21.921134 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-3f4281ba-30df-4edc-adae-08df6c6084f4 req-a5afa91e-fdf6-45a9-b355-ee1d37f605d3 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:21.921614 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-3f4281ba-30df-4edc-adae-08df6c6084f4 req-a5afa91e-fdf6-45a9-b355-ee1d37f605d3 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:21.922046 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-3f4281ba-30df-4edc-adae-08df6c6084f4 req-a5afa91e-fdf6-45a9-b355-ee1d37f605d3 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:21.936697 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-3f4281ba-30df-4edc-adae-08df6c6084f4 req-a5afa91e-fdf6-45a9-b355-ee1d37f605d3 service nova] Creating event network-vif-unplugged:4f8cb1f4-9a9e-4789-ab3a-fe22f32e08ea for instance de326118-88c5-4143-ba33-ec222ab9a374 on hv-cinder-85236 Aug 26 09:04:21.942408 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-3f4281ba-30df-4edc-adae-08df6c6084f4 req-a5afa91e-fdf6-45a9-b355-ee1d37f605d3 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036246 Aug 26 09:04:21.943072 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 584/1180] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:04:22.196476 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-42ff57ad-f304-4c5f-bf6c-a03d6bdb8c67 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:22.197213 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-42ff57ad-f304-4c5f-bf6c-a03d6bdb8c67 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:22.203960 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-42ff57ad-f304-4c5f-bf6c-a03d6bdb8c67 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:22.204439 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-42ff57ad-f304-4c5f-bf6c-a03d6bdb8c67 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:22.204867 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-42ff57ad-f304-4c5f-bf6c-a03d6bdb8c67 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:22.205758 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-42ff57ad-f304-4c5f-bf6c-a03d6bdb8c67 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:22.206311 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-42ff57ad-f304-4c5f-bf6c-a03d6bdb8c67 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:22.206448 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-42ff57ad-f304-4c5f-bf6c-a03d6bdb8c67 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:22.351273 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-42ff57ad-f304-4c5f-bf6c-a03d6bdb8c67 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:22.359939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-42ff57ad-f304-4c5f-bf6c-a03d6bdb8c67 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1576 microversion: 2.1 time: 0.167494 Aug 26 09:04:22.361229 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 597/1181] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:22 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 09:04:23.382454 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-af5a5cd8-a5bc-4bf0-8f94-acf90b7f2e18 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:23.383204 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-af5a5cd8-a5bc-4bf0-8f94-acf90b7f2e18 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:23.390454 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af5a5cd8-a5bc-4bf0-8f94-acf90b7f2e18 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:23.390985 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af5a5cd8-a5bc-4bf0-8f94-acf90b7f2e18 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:23.391420 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af5a5cd8-a5bc-4bf0-8f94-acf90b7f2e18 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:23.392148 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af5a5cd8-a5bc-4bf0-8f94-acf90b7f2e18 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:23.392588 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af5a5cd8-a5bc-4bf0-8f94-acf90b7f2e18 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:23.393028 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-af5a5cd8-a5bc-4bf0-8f94-acf90b7f2e18 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:23.540528 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-af5a5cd8-a5bc-4bf0-8f94-acf90b7f2e18 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:23.555656 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-af5a5cd8-a5bc-4bf0-8f94-acf90b7f2e18 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1576 microversion: 2.1 time: 0.173012 Aug 26 09:04:23.555656 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 585/1182] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:23 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:23.831994 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-40a4b2c3-87db-492d-8650-4b258dfb4695 req-829bdfd9-ee59-43fc-b273-e80fe0cc39cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de326118-88c5-4143-ba33-ec222ab9a374", "name": "network-vif-deleted", "tag": "4f8cb1f4-9a9e-4789-ab3a-fe22f32e08ea"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:04:23.842429 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-40a4b2c3-87db-492d-8650-4b258dfb4695 req-829bdfd9-ee59-43fc-b273-e80fe0cc39cc service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:23.842924 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-40a4b2c3-87db-492d-8650-4b258dfb4695 req-829bdfd9-ee59-43fc-b273-e80fe0cc39cc service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:23.843344 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-40a4b2c3-87db-492d-8650-4b258dfb4695 req-829bdfd9-ee59-43fc-b273-e80fe0cc39cc service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:23.856612 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-40a4b2c3-87db-492d-8650-4b258dfb4695 req-829bdfd9-ee59-43fc-b273-e80fe0cc39cc service nova] Creating event network-vif-deleted:4f8cb1f4-9a9e-4789-ab3a-fe22f32e08ea for instance de326118-88c5-4143-ba33-ec222ab9a374 on hv-cinder-85236 Aug 26 09:04:23.863427 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-40a4b2c3-87db-492d-8650-4b258dfb4695 req-829bdfd9-ee59-43fc-b273-e80fe0cc39cc service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036305 Aug 26 09:04:23.864053 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 598/1183] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:04:24.579300 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1225e24d-abfa-4022-8cb3-e3b9a8c5a9b8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:24.579917 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1225e24d-abfa-4022-8cb3-e3b9a8c5a9b8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:24.587557 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1225e24d-abfa-4022-8cb3-e3b9a8c5a9b8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:24.588038 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1225e24d-abfa-4022-8cb3-e3b9a8c5a9b8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:24.588465 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1225e24d-abfa-4022-8cb3-e3b9a8c5a9b8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:24.589159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1225e24d-abfa-4022-8cb3-e3b9a8c5a9b8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:24.590482 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1225e24d-abfa-4022-8cb3-e3b9a8c5a9b8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:24.590962 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1225e24d-abfa-4022-8cb3-e3b9a8c5a9b8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:24.627600 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1225e24d-abfa-4022-8cb3-e3b9a8c5a9b8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:24.628078 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1225e24d-abfa-4022-8cb3-e3b9a8c5a9b8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:24.628527 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1225e24d-abfa-4022-8cb3-e3b9a8c5a9b8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:24.629009 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-1225e24d-abfa-4022-8cb3-e3b9a8c5a9b8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lazy-loading 'fault' on Instance uuid de326118-88c5-4143-ba33-ec222ab9a374 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 09:04:24.675630 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1225e24d-abfa-4022-8cb3-e3b9a8c5a9b8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:24.689196 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1225e24d-abfa-4022-8cb3-e3b9a8c5a9b8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 200 len: 1184 microversion: 2.1 time: 0.115274 Aug 26 09:04:24.690070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 586/1184] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:24 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 1184 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 09:04:25.714178 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-04ec1cf8-55aa-4b25-9094-6509ae52d998 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:25.715037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-04ec1cf8-55aa-4b25-9094-6509ae52d998 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:25.723122 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-04ec1cf8-55aa-4b25-9094-6509ae52d998 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:25.723677 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-04ec1cf8-55aa-4b25-9094-6509ae52d998 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:25.724106 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-04ec1cf8-55aa-4b25-9094-6509ae52d998 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:25.724861 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-04ec1cf8-55aa-4b25-9094-6509ae52d998 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:25.725427 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-04ec1cf8-55aa-4b25-9094-6509ae52d998 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:25.725791 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-04ec1cf8-55aa-4b25-9094-6509ae52d998 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:25.740233 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-04ec1cf8-55aa-4b25-9094-6509ae52d998 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] HTTP exception thrown: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-04ec1cf8-55aa-4b25-9094-6509ae52d998 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Request method failure captured: Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 HTTP/1.1 Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIvCCFZ3TUYbKEFZHZqLOj2-OP6qLTmtzItn9D8Fg6Q_0DCuqNr92oEULEEE8738yItpANphQVSVghcOjfML_YdDD_7-ddn1DPBefB6PyqFKq86jQqNP6hgvmMtdRpk1ZCk1cayAIz79YphIqz0lctR_eJRuikOFvBgT-kVaNyRNOPo Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 6773ba16da8845d39c90a627802cf05f Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:04:25.741939 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:04:25.743990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_6773ba16da8845d39c90a627802cf05f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:04:25.743990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:04:25.743990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 6773ba16da8845d39c90a627802cf05f Aug 26 09:04:25.743990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:04:25.743990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-TestVolumeBootPattern-1537256316-project Aug 26 09:04:25.743990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:04:25.743990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:04:25.743990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 34eaab912a91496daeedbaf63f5ddcbb Aug 26 09:04:25.743990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-TestVolumeBootPattern-1537256316-project Aug 26 09:04:25.743990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:04:25.743990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:04:25.743990 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': 'de326118-88c5-4143-ba33-ec222ab9a374'} Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:04:25.745190 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:04:25.747848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:04:25.750214 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-04ec1cf8-55aa-4b25-9094-6509ae52d998 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Returning 404 to user: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:04:25.750214 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-04ec1cf8-55aa-4b25-9094-6509ae52d998 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 404 len: 111 microversion: 2.1 time: 0.035085 Aug 26 09:04:25.750214 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 599/1185] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:25 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:04:25.854297 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-847844997", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-484925391", "security_groups": [{"name": "tempest-secgroup-smoke-664018262"}], "block_device_mapping_v2": [{"uuid": "f97d772e-435e-4ad3-96c2-b9e2c8e12512", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f3820959-3ded-44b4-b94f-e8c3d94acf11"}]}} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:04:25.973562 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.network.neutron [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] validate_networks() for [('f3820959-3ded-44b4-b94f-e8c3d94acf11', None, None, None, None, None)] {{(pid=132218) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 09:04:26.376025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Flavor limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 09:04:26.376025 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Image limits 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 09:04:26.376412 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Flavor pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 09:04:26.376813 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Image pref 0:0:0 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 09:04:26.377207 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.virt.hardware [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132218) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 09:04:26.387931 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:26.388394 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:26.388817 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:26.389533 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:26.389972 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:26.390385 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:26.408156 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Getting quotas for project 6773ba16da8845d39c90a627802cf05f. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 09:04:26.412620 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.quota [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Getting quotas for user 34eaab912a91496daeedbaf63f5ddcbb and project 6773ba16da8845d39c90a627802cf05f. Resources: {'instances', 'cores', 'ram'} {{(pid=132218) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 09:04:26.478982 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Going to run 1 instances... {{(pid=132218) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 09:04:26.481179 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f97d772e-435e-4ad3-96c2-b9e2c8e12512',volume_size=None,volume_type=None)] {{(pid=132218) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 09:04:26.635475 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-c4373f5a-1e73-444b-a092-f4623c9cda8a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.785049 Aug 26 09:04:26.636804 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 587/1186] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 09:04:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 09:04:26.648852 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-142cde1e-2865-4099-9fac-88166c7d0083 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:26.649569 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-142cde1e-2865-4099-9fac-88166c7d0083 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:26.707599 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-142cde1e-2865-4099-9fac-88166c7d0083 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:26.715500 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-142cde1e-2865-4099-9fac-88166c7d0083 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1093 microversion: 2.1 time: 0.070897 Aug 26 09:04:26.716114 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 600/1187] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:26 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:27.735478 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-aa65ccc4-271c-447a-b937-07e8684dee77 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:27.736256 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-aa65ccc4-271c-447a-b937-07e8684dee77 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:27.745667 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa65ccc4-271c-447a-b937-07e8684dee77 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:27.746157 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa65ccc4-271c-447a-b937-07e8684dee77 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:27.746587 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa65ccc4-271c-447a-b937-07e8684dee77 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:27.747351 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa65ccc4-271c-447a-b937-07e8684dee77 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:27.747804 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa65ccc4-271c-447a-b937-07e8684dee77 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:27.748246 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-aa65ccc4-271c-447a-b937-07e8684dee77 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:27.833570 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-aa65ccc4-271c-447a-b937-07e8684dee77 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:27.842618 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-aa65ccc4-271c-447a-b937-07e8684dee77 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1199 microversion: 2.1 time: 0.111109 Aug 26 09:04:27.843243 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 588/1188] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:27 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1199 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:28.864695 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a4323986-d705-4462-897d-4761fcac7324 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:28.865538 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a4323986-d705-4462-897d-4761fcac7324 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:28.874638 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a4323986-d705-4462-897d-4761fcac7324 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:28.875080 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a4323986-d705-4462-897d-4761fcac7324 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:28.875495 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a4323986-d705-4462-897d-4761fcac7324 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:28.876208 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a4323986-d705-4462-897d-4761fcac7324 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:28.876696 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a4323986-d705-4462-897d-4761fcac7324 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:28.877128 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a4323986-d705-4462-897d-4761fcac7324 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:29.121221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a4323986-d705-4462-897d-4761fcac7324 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:29.129981 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a4323986-d705-4462-897d-4761fcac7324 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1264 microversion: 2.1 time: 0.269537 Aug 26 09:04:29.130593 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 601/1189] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:28 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:29.282199 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-38b89a76-2ac7-4f79-80a7-9de73919f65e req-2337cc49-d7a7-4aa1-9364-02fe99bf3f7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8af299-5833-4af2-9b87-31f5e1138bd8", "tag": "9398cc79-450a-4494-8548-330be1511b9d"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:04:29.298459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-38b89a76-2ac7-4f79-80a7-9de73919f65e req-2337cc49-d7a7-4aa1-9364-02fe99bf3f7e service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:29.299183 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-38b89a76-2ac7-4f79-80a7-9de73919f65e req-2337cc49-d7a7-4aa1-9364-02fe99bf3f7e service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:29.299775 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-38b89a76-2ac7-4f79-80a7-9de73919f65e req-2337cc49-d7a7-4aa1-9364-02fe99bf3f7e service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:29.314589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-38b89a76-2ac7-4f79-80a7-9de73919f65e req-2337cc49-d7a7-4aa1-9364-02fe99bf3f7e service nova] Creating event network-changed:9398cc79-450a-4494-8548-330be1511b9d for instance 5c8af299-5833-4af2-9b87-31f5e1138bd8 on hv-cinder-85236 Aug 26 09:04:29.319826 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-38b89a76-2ac7-4f79-80a7-9de73919f65e req-2337cc49-d7a7-4aa1-9364-02fe99bf3f7e service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044764 Aug 26 09:04:29.320516 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 589/1190] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:04:30.153668 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-77300567-85e7-4de0-9bed-790791d3c42a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:30.154276 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-77300567-85e7-4de0-9bed-790791d3c42a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:30.161784 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77300567-85e7-4de0-9bed-790791d3c42a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:30.162281 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77300567-85e7-4de0-9bed-790791d3c42a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:30.162719 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77300567-85e7-4de0-9bed-790791d3c42a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:30.163480 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77300567-85e7-4de0-9bed-790791d3c42a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:30.163914 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77300567-85e7-4de0-9bed-790791d3c42a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:30.164343 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-77300567-85e7-4de0-9bed-790791d3c42a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:30.394464 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-77300567-85e7-4de0-9bed-790791d3c42a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:30.402954 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-77300567-85e7-4de0-9bed-790791d3c42a tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1264 microversion: 2.1 time: 0.253752 Aug 26 09:04:30.403567 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 602/1191] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:30 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:31.424711 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7227d3ea-c605-43e6-b79f-1ab4b45c7d95 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:31.425386 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-7227d3ea-c605-43e6-b79f-1ab4b45c7d95 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:31.432893 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7227d3ea-c605-43e6-b79f-1ab4b45c7d95 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:31.433389 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7227d3ea-c605-43e6-b79f-1ab4b45c7d95 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:31.433813 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7227d3ea-c605-43e6-b79f-1ab4b45c7d95 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:31.434511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7227d3ea-c605-43e6-b79f-1ab4b45c7d95 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:31.434988 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7227d3ea-c605-43e6-b79f-1ab4b45c7d95 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:31.435405 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7227d3ea-c605-43e6-b79f-1ab4b45c7d95 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:31.580705 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-7227d3ea-c605-43e6-b79f-1ab4b45c7d95 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:31.593646 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7227d3ea-c605-43e6-b79f-1ab4b45c7d95 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1264 microversion: 2.1 time: 0.173416 Aug 26 09:04:31.594566 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 590/1192] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:31 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:32.615289 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-787c2620-3a05-47ba-94a8-d16a6002f1d2 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:32.615994 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-787c2620-3a05-47ba-94a8-d16a6002f1d2 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:32.624711 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-787c2620-3a05-47ba-94a8-d16a6002f1d2 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:32.625572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-787c2620-3a05-47ba-94a8-d16a6002f1d2 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:32.625959 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-787c2620-3a05-47ba-94a8-d16a6002f1d2 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:32.626687 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-787c2620-3a05-47ba-94a8-d16a6002f1d2 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:32.627152 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-787c2620-3a05-47ba-94a8-d16a6002f1d2 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:32.627848 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-787c2620-3a05-47ba-94a8-d16a6002f1d2 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:32.777564 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-787c2620-3a05-47ba-94a8-d16a6002f1d2 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:32.786044 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-787c2620-3a05-47ba-94a8-d16a6002f1d2 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1264 microversion: 2.1 time: 0.174881 Aug 26 09:04:32.786636 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 603/1193] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:32 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:33.808110 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-cd542e0c-8be7-4ad5-8f20-503d19c3caff tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:33.808916 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-cd542e0c-8be7-4ad5-8f20-503d19c3caff tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:33.817765 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd542e0c-8be7-4ad5-8f20-503d19c3caff tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:33.818514 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd542e0c-8be7-4ad5-8f20-503d19c3caff tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:33.818913 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd542e0c-8be7-4ad5-8f20-503d19c3caff tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:33.820243 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd542e0c-8be7-4ad5-8f20-503d19c3caff tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:33.820243 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd542e0c-8be7-4ad5-8f20-503d19c3caff tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:33.820636 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-cd542e0c-8be7-4ad5-8f20-503d19c3caff tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:33.997798 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-cd542e0c-8be7-4ad5-8f20-503d19c3caff tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:34.007605 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-cd542e0c-8be7-4ad5-8f20-503d19c3caff tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1264 microversion: 2.1 time: 0.203712 Aug 26 09:04:34.008219 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 591/1194] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:33 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:35.030037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-8f908b40-48ed-49b3-aa75-2ce0125de2cf tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:35.030648 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-8f908b40-48ed-49b3-aa75-2ce0125de2cf tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:35.037457 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f908b40-48ed-49b3-aa75-2ce0125de2cf tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:35.037969 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f908b40-48ed-49b3-aa75-2ce0125de2cf tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:35.038405 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f908b40-48ed-49b3-aa75-2ce0125de2cf tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:35.039147 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f908b40-48ed-49b3-aa75-2ce0125de2cf tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:35.039597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f908b40-48ed-49b3-aa75-2ce0125de2cf tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:35.040017 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-8f908b40-48ed-49b3-aa75-2ce0125de2cf tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:35.196254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-8f908b40-48ed-49b3-aa75-2ce0125de2cf tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:35.204639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-8f908b40-48ed-49b3-aa75-2ce0125de2cf tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1264 microversion: 2.1 time: 0.178700 Aug 26 09:04:35.205226 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 604/1195] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:35 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:36.228841 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5367a99c-e972-4da0-8bd6-752de787aae6 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:36.229477 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5367a99c-e972-4da0-8bd6-752de787aae6 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:36.236924 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5367a99c-e972-4da0-8bd6-752de787aae6 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:36.237409 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5367a99c-e972-4da0-8bd6-752de787aae6 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:36.237833 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5367a99c-e972-4da0-8bd6-752de787aae6 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:36.238525 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5367a99c-e972-4da0-8bd6-752de787aae6 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:36.238992 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5367a99c-e972-4da0-8bd6-752de787aae6 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:36.239406 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5367a99c-e972-4da0-8bd6-752de787aae6 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:36.379427 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5367a99c-e972-4da0-8bd6-752de787aae6 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:36.388745 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5367a99c-e972-4da0-8bd6-752de787aae6 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1264 microversion: 2.1 time: 0.165977 Aug 26 09:04:36.389316 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 592/1196] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:36 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:37.409925 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c2fdc43f-d4d5-4a2a-9050-caba5c8db34e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:37.410561 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c2fdc43f-d4d5-4a2a-9050-caba5c8db34e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:37.413267 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:37.419140 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2fdc43f-d4d5-4a2a-9050-caba5c8db34e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:37.419971 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2fdc43f-d4d5-4a2a-9050-caba5c8db34e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:37.420404 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2fdc43f-d4d5-4a2a-9050-caba5c8db34e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:37.421238 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2fdc43f-d4d5-4a2a-9050-caba5c8db34e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:37.421568 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2fdc43f-d4d5-4a2a-9050-caba5c8db34e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:37.422014 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c2fdc43f-d4d5-4a2a-9050-caba5c8db34e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:37.570914 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c2fdc43f-d4d5-4a2a-9050-caba5c8db34e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:37.580101 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c2fdc43f-d4d5-4a2a-9050-caba5c8db34e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1264 microversion: 2.1 time: 0.174052 Aug 26 09:04:37.580704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 605/1197] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:37 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:38.603630 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b304bd69-3191-4e26-af9c-9e60d1efd48b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:38.604252 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b304bd69-3191-4e26-af9c-9e60d1efd48b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:38.606262 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:38.607138 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=6 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:04:38.613546 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b304bd69-3191-4e26-af9c-9e60d1efd48b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:38.613952 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b304bd69-3191-4e26-af9c-9e60d1efd48b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:38.614480 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b304bd69-3191-4e26-af9c-9e60d1efd48b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:38.615435 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b304bd69-3191-4e26-af9c-9e60d1efd48b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:38.615724 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b304bd69-3191-4e26-af9c-9e60d1efd48b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:38.616142 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b304bd69-3191-4e26-af9c-9e60d1efd48b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:38.758369 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b304bd69-3191-4e26-af9c-9e60d1efd48b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:38.769165 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b304bd69-3191-4e26-af9c-9e60d1efd48b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1264 microversion: 2.1 time: 0.170918 Aug 26 09:04:38.770111 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 593/1198] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:38 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:39.791604 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6529d98b-ba57-462b-a2cc-af9e7c4119b0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:39.792703 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6529d98b-ba57-462b-a2cc-af9e7c4119b0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:39.799916 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6529d98b-ba57-462b-a2cc-af9e7c4119b0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:39.800403 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6529d98b-ba57-462b-a2cc-af9e7c4119b0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:39.800834 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6529d98b-ba57-462b-a2cc-af9e7c4119b0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:39.801546 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6529d98b-ba57-462b-a2cc-af9e7c4119b0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:39.801995 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6529d98b-ba57-462b-a2cc-af9e7c4119b0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:39.802411 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6529d98b-ba57-462b-a2cc-af9e7c4119b0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:39.948402 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6529d98b-ba57-462b-a2cc-af9e7c4119b0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:39.958302 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6529d98b-ba57-462b-a2cc-af9e7c4119b0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1264 microversion: 2.1 time: 0.171522 Aug 26 09:04:39.958909 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 606/1199] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:39 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:40.015996 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-443c114f-7481-4aa0-bf81-308f93ba2b7b req-3b688eaf-1a05-483a-8390-4f7db4c47a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8af299-5833-4af2-9b87-31f5e1138bd8", "name": "network-vif-plugged", "status": "completed", "tag": "9398cc79-450a-4494-8548-330be1511b9d"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:04:40.027357 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-443c114f-7481-4aa0-bf81-308f93ba2b7b req-3b688eaf-1a05-483a-8390-4f7db4c47a83 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:40.027851 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-443c114f-7481-4aa0-bf81-308f93ba2b7b req-3b688eaf-1a05-483a-8390-4f7db4c47a83 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:40.028281 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-443c114f-7481-4aa0-bf81-308f93ba2b7b req-3b688eaf-1a05-483a-8390-4f7db4c47a83 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:40.045616 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-443c114f-7481-4aa0-bf81-308f93ba2b7b req-3b688eaf-1a05-483a-8390-4f7db4c47a83 service nova] Creating event network-vif-plugged:9398cc79-450a-4494-8548-330be1511b9d for instance 5c8af299-5833-4af2-9b87-31f5e1138bd8 on hv-cinder-85236 Aug 26 09:04:40.050960 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-443c114f-7481-4aa0-bf81-308f93ba2b7b req-3b688eaf-1a05-483a-8390-4f7db4c47a83 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039366 Aug 26 09:04:40.051581 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 594/1200] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:04:40.981521 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-f4338c73-15b3-4afe-b47f-c834224b1f28 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:40.982203 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-f4338c73-15b3-4afe-b47f-c834224b1f28 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:40.990108 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f4338c73-15b3-4afe-b47f-c834224b1f28 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:40.990597 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f4338c73-15b3-4afe-b47f-c834224b1f28 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:40.991092 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f4338c73-15b3-4afe-b47f-c834224b1f28 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:40.991826 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f4338c73-15b3-4afe-b47f-c834224b1f28 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:40.992277 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f4338c73-15b3-4afe-b47f-c834224b1f28 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:40.992752 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-f4338c73-15b3-4afe-b47f-c834224b1f28 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:41.159404 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-f4338c73-15b3-4afe-b47f-c834224b1f28 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:41.171337 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-f4338c73-15b3-4afe-b47f-c834224b1f28 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1264 microversion: 2.1 time: 0.193969 Aug 26 09:04:41.171952 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 607/1201] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:40 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:42.194608 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b4e77d7c-068d-43fd-b60c-7a653dde2b2d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:42.195509 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b4e77d7c-068d-43fd-b60c-7a653dde2b2d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:42.202576 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b4e77d7c-068d-43fd-b60c-7a653dde2b2d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:42.203090 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b4e77d7c-068d-43fd-b60c-7a653dde2b2d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:42.203547 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b4e77d7c-068d-43fd-b60c-7a653dde2b2d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:42.204702 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b4e77d7c-068d-43fd-b60c-7a653dde2b2d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:42.205292 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b4e77d7c-068d-43fd-b60c-7a653dde2b2d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:42.205791 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b4e77d7c-068d-43fd-b60c-7a653dde2b2d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:42.382587 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-b4e77d7c-068d-43fd-b60c-7a653dde2b2d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:42.392125 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b4e77d7c-068d-43fd-b60c-7a653dde2b2d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1451 microversion: 2.1 time: 0.203098 Aug 26 09:04:42.392764 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 595/1202] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:42 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1451 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:42.413891 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6ef171dd-19a1-46b8-be6a-2c708e8f1963 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:04:42.414529 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6ef171dd-19a1-46b8-be6a-2c708e8f1963 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:04:42.421928 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ef171dd-19a1-46b8-be6a-2c708e8f1963 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:42.422531 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ef171dd-19a1-46b8-be6a-2c708e8f1963 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:42.423004 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ef171dd-19a1-46b8-be6a-2c708e8f1963 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:42.423726 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ef171dd-19a1-46b8-be6a-2c708e8f1963 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:42.424208 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ef171dd-19a1-46b8-be6a-2c708e8f1963 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:42.424749 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6ef171dd-19a1-46b8-be6a-2c708e8f1963 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:42.903113 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6ef171dd-19a1-46b8-be6a-2c708e8f1963 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:04:42.916176 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6ef171dd-19a1-46b8-be6a-2c708e8f1963 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1451 microversion: 2.1 time: 0.505761 Aug 26 09:04:42.917212 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 608/1203] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:04:42 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1451 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:04:45.035371 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-b659760e-f88b-4383-8e42-49abbea5ba71 req-ebfe83d9-8fe4-40f3-a382-c7b589e99569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8af299-5833-4af2-9b87-31f5e1138bd8", "tag": "9398cc79-450a-4494-8548-330be1511b9d"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:04:45.045537 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-b659760e-f88b-4383-8e42-49abbea5ba71 req-ebfe83d9-8fe4-40f3-a382-c7b589e99569 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:04:45.046012 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-b659760e-f88b-4383-8e42-49abbea5ba71 req-ebfe83d9-8fe4-40f3-a382-c7b589e99569 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:04:45.046610 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-b659760e-f88b-4383-8e42-49abbea5ba71 req-ebfe83d9-8fe4-40f3-a382-c7b589e99569 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:04:45.071881 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-b659760e-f88b-4383-8e42-49abbea5ba71 req-ebfe83d9-8fe4-40f3-a382-c7b589e99569 service nova] Creating event network-changed:9398cc79-450a-4494-8548-330be1511b9d for instance 5c8af299-5833-4af2-9b87-31f5e1138bd8 on hv-cinder-85236 Aug 26 09:04:45.077393 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-b659760e-f88b-4383-8e42-49abbea5ba71 req-ebfe83d9-8fe4-40f3-a382-c7b589e99569 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190268 Aug 26 09:04:45.078262 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 596/1204] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:06:32.514325 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1cc7bd69-e1ac-4328-8686-1e5210813341] AMQP server on 10.222.0.71:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 26 09:06:32.516415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=32 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:06:32.516415 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=76 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:06:32.522638 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1144647388", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-484925391", "security_groups": [{"name": "tempest-secgroup-smoke-664018262"}], "block_device_mapping_v2": [{"uuid": "a9ea5c25-404b-48d8-9b57-f11f6c3c51b7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f3820959-3ded-44b4-b94f-e8c3d94acf11"}]}} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:06:32.664458 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.network.neutron [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] validate_networks() for [('f3820959-3ded-44b4-b94f-e8c3d94acf11', None, None, None, None, None)] {{(pid=132217) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 09:06:33.223559 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Flavor limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 09:06:33.223994 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Image limits 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 09:06:33.224471 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Flavor pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 09:06:33.224879 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Image pref 0:0:0 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 09:06:33.225289 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.virt.hardware [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 09:06:33.237836 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:33.238319 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:33.238750 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:33.239516 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:33.240002 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:33.240448 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:33.258674 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Getting quotas for project 6773ba16da8845d39c90a627802cf05f. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 09:06:33.262947 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.quota [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Getting quotas for user 34eaab912a91496daeedbaf63f5ddcbb and project 6773ba16da8845d39c90a627802cf05f. Resources: {'instances', 'cores', 'ram'} {{(pid=132217) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 09:06:33.400696 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Going to run 1 instances... {{(pid=132217) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 09:06:33.402818 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a9ea5c25-404b-48d8-9b57-f11f6c3c51b7',volume_size=None,volume_type=None)] {{(pid=132217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 09:06:33.561221 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO oslo.messaging._drivers.impl_rabbit [-] [1cc7bd69-e1ac-4328-8686-1e5210813341] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 35066. Aug 26 09:06:33.588037 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-43bc0c86-85e5-43bc-91ad-06491eeb3798 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.075537 Aug 26 09:06:33.588922 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 609/1205] 10.222.0.71 () {60 vars in 1147 bytes} [Fri Aug 26 09:06:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 09:06:33.600351 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f274071-e1a5-496b-8fb5-4b6fbc055c42] AMQP server on 10.222.0.71:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 26 09:06:33.603284 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:06:33.603284 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:06:33.610353 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-04cb4194-7b1d-44f4-9236-5d81f336e4a6 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:33.611594 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-04cb4194-7b1d-44f4-9236-5d81f336e4a6 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:33.772722 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-04cb4194-7b1d-44f4-9236-5d81f336e4a6 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:33.781363 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-04cb4194-7b1d-44f4-9236-5d81f336e4a6 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1094 microversion: 2.1 time: 0.184787 Aug 26 09:06:33.782060 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 597/1206] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:33 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1094 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:06:34.810154 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6686fce9-f7ab-4f39-8f58-2494a8b5b4aa tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:34.811073 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6686fce9-f7ab-4f39-8f58-2494a8b5b4aa tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:34.823836 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6686fce9-f7ab-4f39-8f58-2494a8b5b4aa tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:34.824348 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6686fce9-f7ab-4f39-8f58-2494a8b5b4aa tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:34.827364 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6686fce9-f7ab-4f39-8f58-2494a8b5b4aa tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:34.836371 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6686fce9-f7ab-4f39-8f58-2494a8b5b4aa tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:34.837222 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6686fce9-f7ab-4f39-8f58-2494a8b5b4aa tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:34.837672 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6686fce9-f7ab-4f39-8f58-2494a8b5b4aa tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:34.950669 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6686fce9-f7ab-4f39-8f58-2494a8b5b4aa tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:34.961811 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6686fce9-f7ab-4f39-8f58-2494a8b5b4aa tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1200 microversion: 2.1 time: 0.158672 Aug 26 09:06:34.962528 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 610/1207] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:34 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1200 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:06:35.987191 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-434487fd-f428-42b4-801c-c4247b018b88 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:35.988070 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-434487fd-f428-42b4-801c-c4247b018b88 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:35.999671 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f274071-e1a5-496b-8fb5-4b6fbc055c42] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 35088. Aug 26 09:06:36.005087 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-434487fd-f428-42b4-801c-c4247b018b88 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:36.005589 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-434487fd-f428-42b4-801c-c4247b018b88 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:36.013021 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-434487fd-f428-42b4-801c-c4247b018b88 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:36.013021 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-434487fd-f428-42b4-801c-c4247b018b88 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:36.013021 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-434487fd-f428-42b4-801c-c4247b018b88 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:36.013021 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-434487fd-f428-42b4-801c-c4247b018b88 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:36.190234 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-434487fd-f428-42b4-801c-c4247b018b88 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:36.199422 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-434487fd-f428-42b4-801c-c4247b018b88 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1265 microversion: 2.1 time: 0.216919 Aug 26 09:06:36.200342 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 598/1208] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:35 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:06:36.406439 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-c651adf5-6a2f-4816-94d0-979b394c36e6 req-05ac8b43-e99a-4037-bde0-a74f2157a81a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfacb28e-2616-416c-bada-df2f05f93097", "tag": "7a2f6b20-eeba-4efa-9fbe-71178238bb6e"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:06:36.417868 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-c651adf5-6a2f-4816-94d0-979b394c36e6 req-05ac8b43-e99a-4037-bde0-a74f2157a81a service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:36.418370 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-c651adf5-6a2f-4816-94d0-979b394c36e6 req-05ac8b43-e99a-4037-bde0-a74f2157a81a service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:36.418800 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-c651adf5-6a2f-4816-94d0-979b394c36e6 req-05ac8b43-e99a-4037-bde0-a74f2157a81a service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:36.435018 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-c651adf5-6a2f-4816-94d0-979b394c36e6 req-05ac8b43-e99a-4037-bde0-a74f2157a81a service nova] Creating event network-changed:7a2f6b20-eeba-4efa-9fbe-71178238bb6e for instance dfacb28e-2616-416c-bada-df2f05f93097 on hv-cinder-85236 Aug 26 09:06:36.441476 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-c651adf5-6a2f-4816-94d0-979b394c36e6 req-05ac8b43-e99a-4037-bde0-a74f2157a81a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039552 Aug 26 09:06:36.442246 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 611/1209] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:06:37.226295 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-ddc34456-8154-4c7f-8f64-b4125853d3c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:37.227115 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-ddc34456-8154-4c7f-8f64-b4125853d3c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:37.234535 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ddc34456-8154-4c7f-8f64-b4125853d3c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:37.235295 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ddc34456-8154-4c7f-8f64-b4125853d3c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:37.235784 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ddc34456-8154-4c7f-8f64-b4125853d3c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:37.236520 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ddc34456-8154-4c7f-8f64-b4125853d3c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:37.236975 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ddc34456-8154-4c7f-8f64-b4125853d3c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:37.237402 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-ddc34456-8154-4c7f-8f64-b4125853d3c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:37.413526 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-ddc34456-8154-4c7f-8f64-b4125853d3c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:37.423216 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-ddc34456-8154-4c7f-8f64-b4125853d3c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1265 microversion: 2.1 time: 0.201400 Aug 26 09:06:37.423825 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 599/1210] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:37 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:06:38.448239 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-29d56bf4-c3ce-4a30-99e2-083d464be2e0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:38.448994 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-29d56bf4-c3ce-4a30-99e2-083d464be2e0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:38.456873 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-29d56bf4-c3ce-4a30-99e2-083d464be2e0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:38.457409 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-29d56bf4-c3ce-4a30-99e2-083d464be2e0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:38.457862 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-29d56bf4-c3ce-4a30-99e2-083d464be2e0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:38.458580 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-29d56bf4-c3ce-4a30-99e2-083d464be2e0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:38.459112 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-29d56bf4-c3ce-4a30-99e2-083d464be2e0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:38.459524 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-29d56bf4-c3ce-4a30-99e2-083d464be2e0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:38.626874 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-29d56bf4-c3ce-4a30-99e2-083d464be2e0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:38.636572 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-29d56bf4-c3ce-4a30-99e2-083d464be2e0 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1265 microversion: 2.1 time: 0.194162 Aug 26 09:06:38.637142 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 612/1211] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:38 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:06:39.659144 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-1cd39198-b6c9-4b7b-933c-1d437c68b603 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:39.660093 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-1cd39198-b6c9-4b7b-933c-1d437c68b603 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:39.666970 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1cd39198-b6c9-4b7b-933c-1d437c68b603 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:39.667469 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1cd39198-b6c9-4b7b-933c-1d437c68b603 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:39.667899 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1cd39198-b6c9-4b7b-933c-1d437c68b603 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:39.668624 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1cd39198-b6c9-4b7b-933c-1d437c68b603 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:39.669102 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1cd39198-b6c9-4b7b-933c-1d437c68b603 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:39.669558 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-1cd39198-b6c9-4b7b-933c-1d437c68b603 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:39.821992 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-1cd39198-b6c9-4b7b-933c-1d437c68b603 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:39.830644 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-1cd39198-b6c9-4b7b-933c-1d437c68b603 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1265 microversion: 2.1 time: 0.175582 Aug 26 09:06:39.831222 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 600/1212] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:39 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:06:40.852711 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a5ac7b17-0b86-43e6-b833-c89f5c66f90c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:40.853552 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a5ac7b17-0b86-43e6-b833-c89f5c66f90c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:40.862438 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a5ac7b17-0b86-43e6-b833-c89f5c66f90c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:40.863264 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a5ac7b17-0b86-43e6-b833-c89f5c66f90c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:40.868536 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a5ac7b17-0b86-43e6-b833-c89f5c66f90c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:40.869538 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a5ac7b17-0b86-43e6-b833-c89f5c66f90c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:40.870126 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a5ac7b17-0b86-43e6-b833-c89f5c66f90c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:40.870591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a5ac7b17-0b86-43e6-b833-c89f5c66f90c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:41.028320 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-a5ac7b17-0b86-43e6-b833-c89f5c66f90c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:41.037197 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a5ac7b17-0b86-43e6-b833-c89f5c66f90c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1265 microversion: 2.1 time: 0.188952 Aug 26 09:06:41.037818 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 613/1213] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:40 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 09:06:42.058459 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-66086e80-cf78-43ef-85a2-49b4afa8907b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:42.059262 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-66086e80-cf78-43ef-85a2-49b4afa8907b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:42.067608 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-66086e80-cf78-43ef-85a2-49b4afa8907b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:42.068097 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-66086e80-cf78-43ef-85a2-49b4afa8907b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:42.068521 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-66086e80-cf78-43ef-85a2-49b4afa8907b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:42.069218 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-66086e80-cf78-43ef-85a2-49b4afa8907b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:42.069662 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-66086e80-cf78-43ef-85a2-49b4afa8907b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:42.070179 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-66086e80-cf78-43ef-85a2-49b4afa8907b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:42.215301 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-66086e80-cf78-43ef-85a2-49b4afa8907b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:42.223788 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-66086e80-cf78-43ef-85a2-49b4afa8907b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1265 microversion: 2.1 time: 0.169308 Aug 26 09:06:42.224371 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 601/1214] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:42 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:06:43.246112 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-6651b598-fb70-4590-8c1f-9b1a368a602c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:43.247433 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-6651b598-fb70-4590-8c1f-9b1a368a602c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:43.250034 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=2 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:06:43.257158 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6651b598-fb70-4590-8c1f-9b1a368a602c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:43.257646 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6651b598-fb70-4590-8c1f-9b1a368a602c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:43.258074 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6651b598-fb70-4590-8c1f-9b1a368a602c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:43.258814 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6651b598-fb70-4590-8c1f-9b1a368a602c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:43.259297 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6651b598-fb70-4590-8c1f-9b1a368a602c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:43.259714 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-6651b598-fb70-4590-8c1f-9b1a368a602c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:43.275892 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell0:SELECT=6 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:06:43.486679 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-6651b598-fb70-4590-8c1f-9b1a368a602c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:43.498195 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-6651b598-fb70-4590-8c1f-9b1a368a602c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1265 microversion: 2.1 time: 0.257116 Aug 26 09:06:43.498844 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 614/1215] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:43 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:06:44.520322 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-da9bf4a4-296b-4117-ba16-5c1bd812fd40 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:44.521110 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-da9bf4a4-296b-4117-ba16-5c1bd812fd40 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:44.523731 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell0:SELECT=2 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:06:44.532498 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-da9bf4a4-296b-4117-ba16-5c1bd812fd40 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:44.533455 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-da9bf4a4-296b-4117-ba16-5c1bd812fd40 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:44.533616 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-da9bf4a4-296b-4117-ba16-5c1bd812fd40 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:44.534293 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-da9bf4a4-296b-4117-ba16-5c1bd812fd40 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:44.534851 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-da9bf4a4-296b-4117-ba16-5c1bd812fd40 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:44.535491 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-da9bf4a4-296b-4117-ba16-5c1bd812fd40 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:44.680844 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-da9bf4a4-296b-4117-ba16-5c1bd812fd40 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:44.689441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-da9bf4a4-296b-4117-ba16-5c1bd812fd40 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1265 microversion: 2.1 time: 0.173496 Aug 26 09:06:44.690020 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 602/1216] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:44 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:06:45.712169 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-69b615b0-608d-4c20-bbc4-9722015f6153 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:45.712810 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-69b615b0-608d-4c20-bbc4-9722015f6153 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:45.722314 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69b615b0-608d-4c20-bbc4-9722015f6153 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:45.722826 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69b615b0-608d-4c20-bbc4-9722015f6153 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:45.723288 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69b615b0-608d-4c20-bbc4-9722015f6153 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:45.723987 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69b615b0-608d-4c20-bbc4-9722015f6153 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:45.724428 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69b615b0-608d-4c20-bbc4-9722015f6153 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:45.724875 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-69b615b0-608d-4c20-bbc4-9722015f6153 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:45.864210 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-69b615b0-608d-4c20-bbc4-9722015f6153 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:45.876845 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-69b615b0-608d-4c20-bbc4-9722015f6153 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1265 microversion: 2.1 time: 0.170437 Aug 26 09:06:45.877532 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 615/1217] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:45 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:06:46.526168 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [req-1502b662-e208-4518-8670-f5719b574c6b req-ce30d738-a49d-4e9b-a620-bde3564d7458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfacb28e-2616-416c-bada-df2f05f93097", "name": "network-vif-plugged", "status": "completed", "tag": "7a2f6b20-eeba-4efa-9fbe-71178238bb6e"}]} {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:06:46.537165 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-1502b662-e208-4518-8670-f5719b574c6b req-ce30d738-a49d-4e9b-a620-bde3564d7458 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:46.537738 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-1502b662-e208-4518-8670-f5719b574c6b req-ce30d738-a49d-4e9b-a620-bde3564d7458 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:46.538674 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [req-1502b662-e208-4518-8670-f5719b574c6b req-ce30d738-a49d-4e9b-a620-bde3564d7458 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:46.559161 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.compute.server_external_events [req-1502b662-e208-4518-8670-f5719b574c6b req-ce30d738-a49d-4e9b-a620-bde3564d7458 service nova] Creating event network-vif-plugged:7a2f6b20-eeba-4efa-9fbe-71178238bb6e for instance dfacb28e-2616-416c-bada-df2f05f93097 on hv-cinder-85236 Aug 26 09:06:46.567292 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [req-1502b662-e208-4518-8670-f5719b574c6b req-ce30d738-a49d-4e9b-a620-bde3564d7458 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044800 Aug 26 09:06:46.567932 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 603/1218] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:06:46.905177 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-915977f1-e9ea-4381-a4ca-f0577d84430c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:46.905789 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-915977f1-e9ea-4381-a4ca-f0577d84430c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:46.912926 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-915977f1-e9ea-4381-a4ca-f0577d84430c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:46.913453 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-915977f1-e9ea-4381-a4ca-f0577d84430c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:46.913890 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-915977f1-e9ea-4381-a4ca-f0577d84430c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:46.914613 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-915977f1-e9ea-4381-a4ca-f0577d84430c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:46.915105 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-915977f1-e9ea-4381-a4ca-f0577d84430c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:46.915523 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-915977f1-e9ea-4381-a4ca-f0577d84430c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:47.061007 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-915977f1-e9ea-4381-a4ca-f0577d84430c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:47.071011 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-915977f1-e9ea-4381-a4ca-f0577d84430c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1265 microversion: 2.1 time: 0.169945 Aug 26 09:06:47.071546 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 616/1219] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:46 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:06:48.094108 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7bd61427-f741-425a-a5df-1d1ee7f2bb12 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:48.094735 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-7bd61427-f741-425a-a5df-1d1ee7f2bb12 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:48.101511 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7bd61427-f741-425a-a5df-1d1ee7f2bb12 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:48.101989 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7bd61427-f741-425a-a5df-1d1ee7f2bb12 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:48.102396 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7bd61427-f741-425a-a5df-1d1ee7f2bb12 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:48.103126 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7bd61427-f741-425a-a5df-1d1ee7f2bb12 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:48.103572 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7bd61427-f741-425a-a5df-1d1ee7f2bb12 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:48.103985 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7bd61427-f741-425a-a5df-1d1ee7f2bb12 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:48.246692 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-7bd61427-f741-425a-a5df-1d1ee7f2bb12 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:48.258519 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7bd61427-f741-425a-a5df-1d1ee7f2bb12 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1265 microversion: 2.1 time: 0.169162 Aug 26 09:06:48.259452 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 604/1220] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:48 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:06:49.283814 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-127dff96-1c4e-4af8-b35c-1d95ffdbd925 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:49.284437 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-127dff96-1c4e-4af8-b35c-1d95ffdbd925 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:49.291748 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-127dff96-1c4e-4af8-b35c-1d95ffdbd925 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:49.292239 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-127dff96-1c4e-4af8-b35c-1d95ffdbd925 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:49.292669 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-127dff96-1c4e-4af8-b35c-1d95ffdbd925 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:49.293372 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-127dff96-1c4e-4af8-b35c-1d95ffdbd925 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:49.293818 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-127dff96-1c4e-4af8-b35c-1d95ffdbd925 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:49.294242 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-127dff96-1c4e-4af8-b35c-1d95ffdbd925 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:49.443773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-127dff96-1c4e-4af8-b35c-1d95ffdbd925 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:49.451835 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-127dff96-1c4e-4af8-b35c-1d95ffdbd925 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1452 microversion: 2.1 time: 0.172115 Aug 26 09:06:49.452417 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 617/1221] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:49 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:06:49.472553 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-f4fa2e1d-6cba-4012-8070-a9d02098c7ac tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:06:49.473208 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-f4fa2e1d-6cba-4012-8070-a9d02098c7ac tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:06:49.479913 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f4fa2e1d-6cba-4012-8070-a9d02098c7ac tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:49.480398 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f4fa2e1d-6cba-4012-8070-a9d02098c7ac tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:49.480829 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f4fa2e1d-6cba-4012-8070-a9d02098c7ac tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:49.481515 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f4fa2e1d-6cba-4012-8070-a9d02098c7ac tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:49.481967 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f4fa2e1d-6cba-4012-8070-a9d02098c7ac tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:49.482441 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-f4fa2e1d-6cba-4012-8070-a9d02098c7ac tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:49.619184 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-f4fa2e1d-6cba-4012-8070-a9d02098c7ac tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:06:49.627744 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-f4fa2e1d-6cba-4012-8070-a9d02098c7ac tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1452 microversion: 2.1 time: 0.159195 Aug 26 09:06:49.628328 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 605/1222] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:06:49 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:06:51.505115 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-b47bba47-40ff-4aeb-b06b-638c7b8052af req-eff6a309-f0de-418f-b7e4-484168598fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfacb28e-2616-416c-bada-df2f05f93097", "tag": "7a2f6b20-eeba-4efa-9fbe-71178238bb6e"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:06:51.515403 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-b47bba47-40ff-4aeb-b06b-638c7b8052af req-eff6a309-f0de-418f-b7e4-484168598fba service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:06:51.515881 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-b47bba47-40ff-4aeb-b06b-638c7b8052af req-eff6a309-f0de-418f-b7e4-484168598fba service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:06:51.516302 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-b47bba47-40ff-4aeb-b06b-638c7b8052af req-eff6a309-f0de-418f-b7e4-484168598fba service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:06:51.528950 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-b47bba47-40ff-4aeb-b06b-638c7b8052af req-eff6a309-f0de-418f-b7e4-484168598fba service nova] Creating event network-changed:7a2f6b20-eeba-4efa-9fbe-71178238bb6e for instance dfacb28e-2616-416c-bada-df2f05f93097 on hv-cinder-85236 Aug 26 09:06:51.534652 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-b47bba47-40ff-4aeb-b06b-638c7b8052af req-eff6a309-f0de-418f-b7e4-484168598fba service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033299 Aug 26 09:06:51.536207 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 618/1223] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:08:29.642381 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_api:SELECT=20 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:08:29.644704 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:08:29.646009 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG dbcounter [-] [132217] Writing DB stats nova_cell1:SELECT=48 {{(pid=132217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:08:29.647026 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG dbcounter [-] [132218] Writing DB stats nova_cell1:SELECT=44 {{(pid=132218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 09:08:29.647989 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 09:08:29.648157 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Fri Aug 26 09:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 (ip 10.222.0.71) !!! Aug 26 09:08:29.649613 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 09:08:29.649753 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Fri Aug 26 09:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.71) !!! Aug 26 09:08:29.651731 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 09:08:29.651895 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Fri Aug 26 09:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 (ip 10.222.0.71) !!! Aug 26 09:08:29.658187 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-a3a51b22-ffa6-4095-b1b7-667f02ae27ef tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:08:29.664416 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-3cafbd4c-48ab-4294-a3ce-037f0794f828 req-8132bda4-7351-49e4-8692-55f9b3dd6b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfacb28e-2616-416c-bada-df2f05f93097", "tag": "7a2f6b20-eeba-4efa-9fbe-71178238bb6e"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:08:29.670183 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a3a51b22-ffa6-4095-b1b7-667f02ae27ef tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:08:29.678116 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a3a51b22-ffa6-4095-b1b7-667f02ae27ef tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:29.678606 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a3a51b22-ffa6-4095-b1b7-667f02ae27ef tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:29.679053 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a3a51b22-ffa6-4095-b1b7-667f02ae27ef tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:29.679857 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a3a51b22-ffa6-4095-b1b7-667f02ae27ef tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:29.680292 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a3a51b22-ffa6-4095-b1b7-667f02ae27ef tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:29.680708 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-a3a51b22-ffa6-4095-b1b7-667f02ae27ef tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:29.691863 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-3cafbd4c-48ab-4294-a3ce-037f0794f828 req-8132bda4-7351-49e4-8692-55f9b3dd6b6d service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:29.692596 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-3cafbd4c-48ab-4294-a3ce-037f0794f828 req-8132bda4-7351-49e4-8692-55f9b3dd6b6d service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:29.693241 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-3cafbd4c-48ab-4294-a3ce-037f0794f828 req-8132bda4-7351-49e4-8692-55f9b3dd6b6d service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:29.708065 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-3cafbd4c-48ab-4294-a3ce-037f0794f828 req-8132bda4-7351-49e4-8692-55f9b3dd6b6d service nova] Creating event network-changed:7a2f6b20-eeba-4efa-9fbe-71178238bb6e for instance dfacb28e-2616-416c-bada-df2f05f93097 on hv-cinder-85236 Aug 26 09:08:29.713754 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-3cafbd4c-48ab-4294-a3ce-037f0794f828 req-8132bda4-7351-49e4-8692-55f9b3dd6b6d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073266 Aug 26 09:08:29.714029 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-a3a51b22-ffa6-4095-b1b7-667f02ae27ef tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 09:08:29.714966 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 619/1224] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:08:29.811072 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-a3a51b22-ffa6-4095-b1b7-667f02ae27ef tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "DELETE /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 204 len: 0 microversion: 2.1 time: 0.172752 Aug 26 09:08:29.812558 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 606/1225] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 09:08:29 2022] DELETE /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 09:08:29.824345 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-c6bdc393-1ea5-4e3f-b630-150f6a9f7a52 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:08:29.825507 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-c6bdc393-1ea5-4e3f-b630-150f6a9f7a52 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:08:29.833087 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c6bdc393-1ea5-4e3f-b630-150f6a9f7a52 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:29.833693 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c6bdc393-1ea5-4e3f-b630-150f6a9f7a52 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:29.834254 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c6bdc393-1ea5-4e3f-b630-150f6a9f7a52 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:29.835143 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c6bdc393-1ea5-4e3f-b630-150f6a9f7a52 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:29.835702 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c6bdc393-1ea5-4e3f-b630-150f6a9f7a52 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:29.836224 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-c6bdc393-1ea5-4e3f-b630-150f6a9f7a52 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:30.278298 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-c6bdc393-1ea5-4e3f-b630-150f6a9f7a52 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:08:30.286453 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-c6bdc393-1ea5-4e3f-b630-150f6a9f7a52 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1576 microversion: 2.1 time: 0.468205 Aug 26 09:08:30.287418 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 620/1226] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:08:29 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1576 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:08:31.309827 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-5e6222fa-0eb3-4281-bffa-a94857c6458b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:08:31.310605 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-5e6222fa-0eb3-4281-bffa-a94857c6458b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:08:31.318710 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5e6222fa-0eb3-4281-bffa-a94857c6458b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:31.319428 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5e6222fa-0eb3-4281-bffa-a94857c6458b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:31.319924 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5e6222fa-0eb3-4281-bffa-a94857c6458b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:31.320639 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5e6222fa-0eb3-4281-bffa-a94857c6458b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:31.321094 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5e6222fa-0eb3-4281-bffa-a94857c6458b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:31.321513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-5e6222fa-0eb3-4281-bffa-a94857c6458b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:31.510578 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-5e6222fa-0eb3-4281-bffa-a94857c6458b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:08:31.520735 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-5e6222fa-0eb3-4281-bffa-a94857c6458b tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1576 microversion: 2.1 time: 0.214892 Aug 26 09:08:31.521376 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 607/1227] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:08:31 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1576 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:08:31.960802 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-8c1a0cb7-52a2-493c-b962-913b4262aece req-f9c2ca62-9a26-41c9-a00e-a46c8aadad52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfacb28e-2616-416c-bada-df2f05f93097", "name": "network-vif-deleted", "tag": "7a2f6b20-eeba-4efa-9fbe-71178238bb6e"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:08:31.974629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-8c1a0cb7-52a2-493c-b962-913b4262aece req-f9c2ca62-9a26-41c9-a00e-a46c8aadad52 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:31.975447 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-8c1a0cb7-52a2-493c-b962-913b4262aece req-f9c2ca62-9a26-41c9-a00e-a46c8aadad52 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:31.976464 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-8c1a0cb7-52a2-493c-b962-913b4262aece req-f9c2ca62-9a26-41c9-a00e-a46c8aadad52 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:31.990994 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-8c1a0cb7-52a2-493c-b962-913b4262aece req-f9c2ca62-9a26-41c9-a00e-a46c8aadad52 service nova] Creating event network-vif-deleted:7a2f6b20-eeba-4efa-9fbe-71178238bb6e for instance dfacb28e-2616-416c-bada-df2f05f93097 on hv-cinder-85236 Aug 26 09:08:31.996958 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-8c1a0cb7-52a2-493c-b962-913b4262aece req-f9c2ca62-9a26-41c9-a00e-a46c8aadad52 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040643 Aug 26 09:08:31.997773 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 621/1228] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:08:32.543463 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-e79b2c23-3d9c-4c2f-b01d-920602117696 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:08:32.544096 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-e79b2c23-3d9c-4c2f-b01d-920602117696 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:08:32.552804 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e79b2c23-3d9c-4c2f-b01d-920602117696 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:32.553319 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e79b2c23-3d9c-4c2f-b01d-920602117696 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:32.553750 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e79b2c23-3d9c-4c2f-b01d-920602117696 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:32.554470 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e79b2c23-3d9c-4c2f-b01d-920602117696 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:32.555012 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e79b2c23-3d9c-4c2f-b01d-920602117696 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:32.555491 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e79b2c23-3d9c-4c2f-b01d-920602117696 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:32.593265 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e79b2c23-3d9c-4c2f-b01d-920602117696 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:32.593859 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e79b2c23-3d9c-4c2f-b01d-920602117696 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:32.594305 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-e79b2c23-3d9c-4c2f-b01d-920602117696 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:32.594756 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-e79b2c23-3d9c-4c2f-b01d-920602117696 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lazy-loading 'fault' on Instance uuid dfacb28e-2616-416c-bada-df2f05f93097 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 09:08:32.637347 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-e79b2c23-3d9c-4c2f-b01d-920602117696 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:08:32.646643 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-e79b2c23-3d9c-4c2f-b01d-920602117696 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 200 len: 1230 microversion: 2.1 time: 0.107086 Aug 26 09:08:32.647285 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 608/1229] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:08:32 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:08:33.670275 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a7ed1e33-26d5-4137-bf77-be1a42c03a29 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:08:33.670978 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-a7ed1e33-26d5-4137-bf77-be1a42c03a29 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: dfacb28e-2616-416c-bada-df2f05f93097] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:08:33.677884 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a7ed1e33-26d5-4137-bf77-be1a42c03a29 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:33.678318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a7ed1e33-26d5-4137-bf77-be1a42c03a29 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:33.678825 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a7ed1e33-26d5-4137-bf77-be1a42c03a29 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:33.679573 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a7ed1e33-26d5-4137-bf77-be1a42c03a29 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:33.679994 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a7ed1e33-26d5-4137-bf77-be1a42c03a29 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:33.680403 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-a7ed1e33-26d5-4137-bf77-be1a42c03a29 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:33.694834 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-a7ed1e33-26d5-4137-bf77-be1a42c03a29 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] HTTP exception thrown: Instance dfacb28e-2616-416c-bada-df2f05f93097 could not be found. Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a7ed1e33-26d5-4137-bf77-be1a42c03a29 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Request method failure captured: Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 HTTP/1.1 Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIvCCFZ3TUYbKEFZHZqLOj2-OP6qLTmtzItn9D8Fg6Q_0DCuqNr92oEULEEE8738yItpANphQVSVghcOjfML_YdDD_7-ddn1DPBefB6PyqFKq86jQqNP6hgvmMtdRpk1ZCk1cayAIz79YphIqz0lctR_eJRuikOFvBgT-kVaNyRNOPo Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 6773ba16da8845d39c90a627802cf05f Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:08:33.696557 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:08:33.698461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_6773ba16da8845d39c90a627802cf05f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:08:33.698461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:08:33.698461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 6773ba16da8845d39c90a627802cf05f Aug 26 09:08:33.698461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:08:33.698461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-TestVolumeBootPattern-1537256316-project Aug 26 09:08:33.698461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:08:33.698461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:08:33.698461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 34eaab912a91496daeedbaf63f5ddcbb Aug 26 09:08:33.698461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-TestVolumeBootPattern-1537256316-project Aug 26 09:08:33.698461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:08:33.698461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance dfacb28e-2616-416c-bada-df2f05f93097 could not be found. Aug 26 09:08:33.698461 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': 'dfacb28e-2616-416c-bada-df2f05f93097'} Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfacb28e-2616-416c-bada-df2f05f93097 could not be found. Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:08:33.699783 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfacb28e-2616-416c-bada-df2f05f93097 could not be found. Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfacb28e-2616-416c-bada-df2f05f93097 could not be found. Aug 26 09:08:33.701639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:33.703187 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-a7ed1e33-26d5-4137-bf77-be1a42c03a29 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Returning 404 to user: Instance dfacb28e-2616-416c-bada-df2f05f93097 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:08:33.703187 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-a7ed1e33-26d5-4137-bf77-be1a42c03a29 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097" status: 404 len: 111 microversion: 2.1 time: 0.032592 Aug 26 09:08:33.703187 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 622/1230] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:08:33 2022] GET /compute/v2.1/servers/dfacb28e-2616-416c-bada-df2f05f93097 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:08:36.927563 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-b2d89346-a3c5-42c5-8055-f340e5d770e5 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:08:36.928406 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b2d89346-a3c5-42c5-8055-f340e5d770e5 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:08:36.930425 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-559fc4bd-ca25-4c0c-b5f4-f0e95b0e3202 req-aaf462b7-2893-474c-b859-7882ca594d59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8af299-5833-4af2-9b87-31f5e1138bd8", "tag": "9398cc79-450a-4494-8548-330be1511b9d"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:08:36.941456 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-559fc4bd-ca25-4c0c-b5f4-f0e95b0e3202 req-aaf462b7-2893-474c-b859-7882ca594d59 service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:36.942026 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-559fc4bd-ca25-4c0c-b5f4-f0e95b0e3202 req-aaf462b7-2893-474c-b859-7882ca594d59 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:36.942839 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b2d89346-a3c5-42c5-8055-f340e5d770e5 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:36.943091 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-559fc4bd-ca25-4c0c-b5f4-f0e95b0e3202 req-aaf462b7-2893-474c-b859-7882ca594d59 service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:36.943354 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b2d89346-a3c5-42c5-8055-f340e5d770e5 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:36.944176 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b2d89346-a3c5-42c5-8055-f340e5d770e5 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:36.944911 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b2d89346-a3c5-42c5-8055-f340e5d770e5 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:36.945353 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b2d89346-a3c5-42c5-8055-f340e5d770e5 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:36.945970 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-b2d89346-a3c5-42c5-8055-f340e5d770e5 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:36.956988 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-559fc4bd-ca25-4c0c-b5f4-f0e95b0e3202 req-aaf462b7-2893-474c-b859-7882ca594d59 service nova] Creating event network-changed:9398cc79-450a-4494-8548-330be1511b9d for instance 5c8af299-5833-4af2-9b87-31f5e1138bd8 on hv-cinder-85236 Aug 26 09:08:36.963068 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-559fc4bd-ca25-4c0c-b5f4-f0e95b0e3202 req-aaf462b7-2893-474c-b859-7882ca594d59 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039708 Aug 26 09:08:36.964071 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 623/1231] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 09:08:36.983188 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-b2d89346-a3c5-42c5-8055-f340e5d770e5 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Going to try to terminate instance {{(pid=132218) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 09:08:37.124438 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-b2d89346-a3c5-42c5-8055-f340e5d770e5 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "DELETE /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 204 len: 0 microversion: 2.1 time: 0.201109 Aug 26 09:08:37.129482 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 609/1232] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 09:08:36 2022] DELETE /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 09:08:37.135066 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-421c1b33-5488-4290-bfab-540a4ffeda4d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:08:37.136377 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-421c1b33-5488-4290-bfab-540a4ffeda4d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:08:37.143813 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-421c1b33-5488-4290-bfab-540a4ffeda4d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:37.144722 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-421c1b33-5488-4290-bfab-540a4ffeda4d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:37.145784 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-421c1b33-5488-4290-bfab-540a4ffeda4d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:37.146639 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-421c1b33-5488-4290-bfab-540a4ffeda4d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:37.148741 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-421c1b33-5488-4290-bfab-540a4ffeda4d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:37.148741 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-421c1b33-5488-4290-bfab-540a4ffeda4d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:37.306251 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.policy [None req-421c1b33-5488-4290-bfab-540a4ffeda4d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132217) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:08:37.316160 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-421c1b33-5488-4290-bfab-540a4ffeda4d tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1575 microversion: 2.1 time: 0.185441 Aug 26 09:08:37.316725 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 624/1233] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:08:37 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:08:38.338313 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-7636805b-d3f3-4284-9e31-4c13dfc4f5ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:08:38.339049 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-7636805b-d3f3-4284-9e31-4c13dfc4f5ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:08:38.346146 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7636805b-d3f3-4284-9e31-4c13dfc4f5ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:38.346632 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7636805b-d3f3-4284-9e31-4c13dfc4f5ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:38.347158 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7636805b-d3f3-4284-9e31-4c13dfc4f5ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:38.347894 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7636805b-d3f3-4284-9e31-4c13dfc4f5ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:38.348337 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7636805b-d3f3-4284-9e31-4c13dfc4f5ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:38.348747 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-7636805b-d3f3-4284-9e31-4c13dfc4f5ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:38.577943 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-7636805b-d3f3-4284-9e31-4c13dfc4f5ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:08:38.587328 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-7636805b-d3f3-4284-9e31-4c13dfc4f5ab tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1575 microversion: 2.1 time: 0.253450 Aug 26 09:08:38.587924 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 610/1234] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:08:38 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1575 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:08:39.291691 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [req-bd107c9e-6fe7-47c9-8f14-b6e513b2af9e req-38a7ce61-a2fd-436d-90a6-852ae5aa0fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8af299-5833-4af2-9b87-31f5e1138bd8", "name": "network-vif-deleted", "tag": "9398cc79-450a-4494-8548-330be1511b9d"}]} {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 09:08:39.303530 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-bd107c9e-6fe7-47c9-8f14-b6e513b2af9e req-38a7ce61-a2fd-436d-90a6-852ae5aa0fcb service nova] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:39.304022 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-bd107c9e-6fe7-47c9-8f14-b6e513b2af9e req-38a7ce61-a2fd-436d-90a6-852ae5aa0fcb service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:39.304453 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [req-bd107c9e-6fe7-47c9-8f14-b6e513b2af9e req-38a7ce61-a2fd-436d-90a6-852ae5aa0fcb service nova] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:39.318996 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.compute.server_external_events [req-bd107c9e-6fe7-47c9-8f14-b6e513b2af9e req-38a7ce61-a2fd-436d-90a6-852ae5aa0fcb service nova] Creating event network-vif-deleted:9398cc79-450a-4494-8548-330be1511b9d for instance 5c8af299-5833-4af2-9b87-31f5e1138bd8 on hv-cinder-85236 Aug 26 09:08:39.324096 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [req-bd107c9e-6fe7-47c9-8f14-b6e513b2af9e req-38a7ce61-a2fd-436d-90a6-852ae5aa0fcb service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118675 Aug 26 09:08:39.324777 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 625/1235] 10.222.0.71 () {64 vars in 1317 bytes} [Fri Aug 26 09:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 09:08:39.610022 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-fbaef61e-076e-4fb9-a7f6-1b4ddf1234c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:08:39.610728 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-fbaef61e-076e-4fb9-a7f6-1b4ddf1234c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:08:39.619757 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fbaef61e-076e-4fb9-a7f6-1b4ddf1234c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:39.620440 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fbaef61e-076e-4fb9-a7f6-1b4ddf1234c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:39.621179 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fbaef61e-076e-4fb9-a7f6-1b4ddf1234c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:39.621919 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fbaef61e-076e-4fb9-a7f6-1b4ddf1234c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:39.622373 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fbaef61e-076e-4fb9-a7f6-1b4ddf1234c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:39.622805 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fbaef61e-076e-4fb9-a7f6-1b4ddf1234c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:39.658906 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fbaef61e-076e-4fb9-a7f6-1b4ddf1234c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:39.659468 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fbaef61e-076e-4fb9-a7f6-1b4ddf1234c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:39.659901 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-fbaef61e-076e-4fb9-a7f6-1b4ddf1234c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:39.660349 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.objects.instance [None req-fbaef61e-076e-4fb9-a7f6-1b4ddf1234c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lazy-loading 'fault' on Instance uuid 5c8af299-5833-4af2-9b87-31f5e1138bd8 {{(pid=132218) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 09:08:39.707846 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.policy [None req-fbaef61e-076e-4fb9-a7f6-1b4ddf1234c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eaab912a91496daeedbaf63f5ddcbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6773ba16da8845d39c90a627802cf05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132218) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 09:08:39.716950 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-fbaef61e-076e-4fb9-a7f6-1b4ddf1234c8 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 200 len: 1229 microversion: 2.1 time: 0.111047 Aug 26 09:08:39.717542 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 611/1236] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:08:39 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 1229 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 09:08:40.740151 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2ead06f0-3dc7-4b70-a679-f4ee7ccd7a1c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:08:40.740919 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-2ead06f0-3dc7-4b70-a679-f4ee7ccd7a1c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: 5c8af299-5833-4af2-9b87-31f5e1138bd8] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:08:40.749362 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2ead06f0-3dc7-4b70-a679-f4ee7ccd7a1c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:40.749984 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2ead06f0-3dc7-4b70-a679-f4ee7ccd7a1c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:40.750470 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2ead06f0-3dc7-4b70-a679-f4ee7ccd7a1c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:40.751591 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2ead06f0-3dc7-4b70-a679-f4ee7ccd7a1c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:40.752318 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2ead06f0-3dc7-4b70-a679-f4ee7ccd7a1c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:40.752749 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-2ead06f0-3dc7-4b70-a679-f4ee7ccd7a1c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:40.768236 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-2ead06f0-3dc7-4b70-a679-f4ee7ccd7a1c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] HTTP exception thrown: Instance 5c8af299-5833-4af2-9b87-31f5e1138bd8 could not be found. Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2ead06f0-3dc7-4b70-a679-f4ee7ccd7a1c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Request method failure captured: Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 HTTP/1.1 Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIvCCFZ3TUYbKEFZHZqLOj2-OP6qLTmtzItn9D8Fg6Q_0DCuqNr92oEULEEE8738yItpANphQVSVghcOjfML_YdDD_7-ddn1DPBefB6PyqFKq86jQqNP6hgvmMtdRpk1ZCk1cayAIz79YphIqz0lctR_eJRuikOFvBgT-kVaNyRNOPo Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 6773ba16da8845d39c90a627802cf05f Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:08:40.771063 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:08:40.772957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_6773ba16da8845d39c90a627802cf05f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:08:40.772957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:08:40.772957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 6773ba16da8845d39c90a627802cf05f Aug 26 09:08:40.772957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:08:40.772957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-TestVolumeBootPattern-1537256316-project Aug 26 09:08:40.772957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:08:40.772957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:08:40.772957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 34eaab912a91496daeedbaf63f5ddcbb Aug 26 09:08:40.772957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-TestVolumeBootPattern-1537256316-project Aug 26 09:08:40.772957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:08:40.772957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance 5c8af299-5833-4af2-9b87-31f5e1138bd8 could not be found. Aug 26 09:08:40.772957 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': '5c8af299-5833-4af2-9b87-31f5e1138bd8'} Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8af299-5833-4af2-9b87-31f5e1138bd8 could not be found. Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:08:40.773929 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8af299-5833-4af2-9b87-31f5e1138bd8 could not be found. Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8af299-5833-4af2-9b87-31f5e1138bd8 could not be found. Aug 26 09:08:40.775629 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:40.777129 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-2ead06f0-3dc7-4b70-a679-f4ee7ccd7a1c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Returning 404 to user: Instance 5c8af299-5833-4af2-9b87-31f5e1138bd8 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:08:40.777129 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-2ead06f0-3dc7-4b70-a679-f4ee7ccd7a1c tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8" status: 404 len: 111 microversion: 2.1 time: 0.037506 Aug 26 09:08:40.777129 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 626/1237] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:08:40 2022] GET /compute/v2.1/servers/5c8af299-5833-4af2-9b87-31f5e1138bd8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:08:41.282677 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9d57846c-2b46-4271-a079-967c6a1d8cd4 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:08:41.283439 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.compute.api [None req-9d57846c-2b46-4271-a079-967c6a1d8cd4 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132218) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:08:41.290568 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d57846c-2b46-4271-a079-967c6a1d8cd4 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:41.291081 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d57846c-2b46-4271-a079-967c6a1d8cd4 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:41.291513 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d57846c-2b46-4271-a079-967c6a1d8cd4 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:41.292226 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d57846c-2b46-4271-a079-967c6a1d8cd4 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:41.292647 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d57846c-2b46-4271-a079-967c6a1d8cd4 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:41.293068 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG oslo_concurrency.lockutils [None req-9d57846c-2b46-4271-a079-967c6a1d8cd4 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:41.314189 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.wsgi [None req-9d57846c-2b46-4271-a079-967c6a1d8cd4 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] HTTP exception thrown: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9d57846c-2b46-4271-a079-967c6a1d8cd4 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Request method failure captured: Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: request: DELETE /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 HTTP/1.1 Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept: application/json Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Accept-Encoding: identity Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Connection: close Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Length: 0 Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Content-Type: application/json Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Host: 10.222.0.71 Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: Openstack-System-Scope: None Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: User-Agent: python-urllib3/1.26.11 Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Auth-Token: gAAAAABjCIvCCFZ3TUYbKEFZHZqLOj2-OP6qLTmtzItn9D8Fg6Q_0DCuqNr92oEULEEE8738yItpANphQVSVghcOjfML_YdDD_7-ddn1DPBefB6PyqFKq86jQqNP6hgvmMtdRpk1ZCk1cayAIz79YphIqz0lctR_eJRuikOFvBgT-kVaNyRNOPo Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Id: None Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Domain-Name: None Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Identity-Status: Confirmed Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Is-Admin-Project: True Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Id: default Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Domain-Name: Default Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Id: 6773ba16da8845d39c90a627802cf05f Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Project-Name: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Role: member,reader Aug 26 09:08:41.316294 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Roles: member,reader Aug 26 09:08:41.317921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_6773ba16da8845d39c90a627802cf05f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:08:41.317921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:08:41.317921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Id: 6773ba16da8845d39c90a627802cf05f Aug 26 09:08:41.317921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-Tenant-Name: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:08:41.317921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User: tempest-TestVolumeBootPattern-1537256316-project Aug 26 09:08:41.317921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Id: default Aug 26 09:08:41.317921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Domain-Name: Default Aug 26 09:08:41.317921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Id: 34eaab912a91496daeedbaf63f5ddcbb Aug 26 09:08:41.317921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: X-User-Name: tempest-TestVolumeBootPattern-1537256316-project Aug 26 09:08:41.317921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: method: > Aug 26 09:08:41.317921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: exception: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:08:41.317921 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: action_args: {'id': 'de326118-88c5-4143-ba33-ec222ab9a374'} Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:08:41.318927 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:08:41.321114 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: ERROR nova.api.openstack.wsgi Aug 26 09:08:41.323159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-9d57846c-2b46-4271-a079-967c6a1d8cd4 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Returning 404 to user: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. {{(pid=132218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:08:41.323159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-9d57846c-2b46-4271-a079-967c6a1d8cd4 tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "DELETE /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 404 len: 111 microversion: 2.1 time: 0.040457 Aug 26 09:08:41.323159 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 612/1238] 10.222.0.71 () {58 vars in 1239 bytes} [Fri Aug 26 09:08:41 2022] DELETE /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:08:41.328867 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d3eb7063-ba0e-45f8-90ce-e1b845f2890e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '>' {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:08:41.329472 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.compute.api [None req-d3eb7063-ba0e-45f8-90ce-e1b845f2890e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] [instance: de326118-88c5-4143-ba33-ec222ab9a374] Fetching instance by UUID {{(pid=132217) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 09:08:41.336226 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d3eb7063-ba0e-45f8-90ce-e1b845f2890e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:41.336720 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d3eb7063-ba0e-45f8-90ce-e1b845f2890e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:41.337319 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d3eb7063-ba0e-45f8-90ce-e1b845f2890e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:41.338658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d3eb7063-ba0e-45f8-90ce-e1b845f2890e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Acquiring lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 09:08:41.338658 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d3eb7063-ba0e-45f8-90ce-e1b845f2890e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 09:08:41.339013 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG oslo_concurrency.lockutils [None req-d3eb7063-ba0e-45f8-90ce-e1b845f2890e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Lock "ca95b6a2-7122-49b3-ad9d-53c968d985a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 09:08:41.355118 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.wsgi [None req-d3eb7063-ba0e-45f8-90ce-e1b845f2890e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] HTTP exception thrown: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d3eb7063-ba0e-45f8-90ce-e1b845f2890e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Request method failure captured: Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: request: GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 HTTP/1.1 Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept: application/json Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Accept-Encoding: identity Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Connection: close Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Length: 0 Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Content-Type: application/json Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Host: 10.222.0.71 Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: Openstack-System-Scope: None Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: User-Agent: python-urllib3/1.26.11 Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Auth-Token: gAAAAABjCIvCCFZ3TUYbKEFZHZqLOj2-OP6qLTmtzItn9D8Fg6Q_0DCuqNr92oEULEEE8738yItpANphQVSVghcOjfML_YdDD_7-ddn1DPBefB6PyqFKq86jQqNP6hgvmMtdRpk1ZCk1cayAIz79YphIqz0lctR_eJRuikOFvBgT-kVaNyRNOPo Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Id: None Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Domain-Name: None Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Identity-Status: Confirmed Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Is-Admin-Project: True Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Id: default Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Domain-Name: Default Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Id: 6773ba16da8845d39c90a627802cf05f Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Project-Name: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Role: member,reader Aug 26 09:08:41.356673 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Roles: member,reader Aug 26 09:08:41.358511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_6773ba16da8845d39c90a627802cf05f", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/6773ba16da8845d39c90a627802cf05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}] Aug 26 09:08:41.358511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:08:41.358511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Id: 6773ba16da8845d39c90a627802cf05f Aug 26 09:08:41.358511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-Tenant-Name: tempest-TestVolumeBootPattern-1537256316 Aug 26 09:08:41.358511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User: tempest-TestVolumeBootPattern-1537256316-project Aug 26 09:08:41.358511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Id: default Aug 26 09:08:41.358511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Domain-Name: Default Aug 26 09:08:41.358511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Id: 34eaab912a91496daeedbaf63f5ddcbb Aug 26 09:08:41.358511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: X-User-Name: tempest-TestVolumeBootPattern-1537256316-project Aug 26 09:08:41.358511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: method: > Aug 26 09:08:41.358511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: exception: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:08:41.358511 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: action_args: {'id': 'de326118-88c5-4143-ba33-ec222ab9a374'} Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: {{(pid=132217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 09:08:41.359847 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. Aug 26 09:08:41.361499 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: ERROR nova.api.openstack.wsgi Aug 26 09:08:41.363147 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: DEBUG nova.api.openstack.wsgi [None req-d3eb7063-ba0e-45f8-90ce-e1b845f2890e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Returning 404 to user: Instance de326118-88c5-4143-ba33-ec222ab9a374 could not be found. {{(pid=132217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 09:08:41.363147 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: INFO nova.api.openstack.requestlog [None req-d3eb7063-ba0e-45f8-90ce-e1b845f2890e tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374" status: 404 len: 111 microversion: 2.1 time: 0.033163 Aug 26 09:08:41.363147 dv-cinder-852364-5-iscsi devstack@n-api.service[132217]: [pid: 132217|app: 0|req: 627/1239] 10.222.0.71 () {58 vars in 1236 bytes} [Fri Aug 26 09:08:41 2022] GET /compute/v2.1/servers/de326118-88c5-4143-ba33-ec222ab9a374 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 09:08:42.695595 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: DEBUG nova.api.openstack.wsgi [None req-2e07ae1b-6b08-48a4-9aa5-e220e3f29f4f tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] Calling method '.version_select at 0x7f136f86ae50>' {{(pid=132218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 09:08:42.738773 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: INFO nova.api.openstack.requestlog [None req-2e07ae1b-6b08-48a4-9aa5-e220e3f29f4f tempest-TestVolumeBootPattern-1537256316 tempest-TestVolumeBootPattern-1537256316-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-484925391" status: 202 len: 0 microversion: 2.1 time: 0.047174 Aug 26 09:08:42.739720 dv-cinder-852364-5-iscsi devstack@n-api.service[132218]: [pid: 132218|app: 0|req: 613/1240] 10.222.0.71 () {58 vars in 1260 bytes} [Fri Aug 26 09:08:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-484925391 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)